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(57) When playing an AV Clip recorded on a 

BD-ROM, a judgment is made, for each elementary 
stream, which of a plurality of predetermined conditions 
the elementary stream satisfies. The plurality of prede- 
termined conditions include (a) a condition that a play- 
back apparatus has a capability of playing the elementary 
stream, (b) a language attribute of the elementary stream 
matches a language setting of the playback apparatus, 
and (c) a channel attribute of the elementary stream is 
surround sound and the playback apparatus has a sur- 
round output capability. The playback apparatus assigns 
a priority to each elementary stream based on which con- 
ditions the elementary stream satisfies, selects an ele- 
mentary stream having a highest priority, and plays the 
selected elementary stream. 
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Check whether audio stream i satisfies (a), (b), and (c) 

(a) playback apparatus is capable of playing audio stream i, 
{comparison between PSRl 5 and stream_CQding_type of audio stream i 

(b) language attribute of audio stream i matches language setting of 
playback apparatus }Audio_ianguage_,code of audio stream i = PSRl 6?} 

(c) channel attribute of audio stream i is surround, and playback apparatus 
is capable of playing it {comparison between PSRl 5 and 
audio_presentation_type and stream_coding_^pe of audio stream i } 



loop for each audio stream 
^59 




S7 
YES 



lnvalid(0xFF)->PSR1 | — SI 4 

YES 



audio stream of highest entry in 
STN_table among audio streams 
that satisfy (a), (b), and (c) •- PSRl 



audio stream of highest entry in 
STN_table among audio streams 
that satisfy (a) and (b) PSRl 



audio stream of highest entry in 
STN_table among audio streams 
that satisfy (a) and (c) PSRl 



audio stream of highest entry 
in STN_table among audio 
streams that satisfy (a) -> PSRl 



, ~F 

( RETURN ^ 



Printed by Jouve, 75001 PARIS (FR) 



1 



EP 1 638 327 A1 



2 



Description 

Technical Field 

[0001] The present invention relates to a playbacl^^ ap- 
paratus for a recording medium, and in particular relates 
to Improvements in a function of selecting one of a plu- 
rality of elementary streams and playing back the select- 
ed elementary stream. 

Background Art 

[0002] In distribution of movie content in recent years, 
the number of streams multiplexed to form one digital 
stream is on the increase. In view of this, the stream 
selection function mentioned above is regarded as par- 
ticularly important. The increase in the numberof streams 
is due to an attempt to support every combination of co- 
dec, channel number, and language attribute. 
[0003] Suppose there are three codecs AC-3 (2ch) , 
AC-3 (5.1ch), and DTS (5.1 ch), and two language at- 
tributes Japanese and English. In this case, six audio 
streams corresponding to six combinations of these co- 
decs and language attributes are produced and multi- 
plexed to form one digital stream. These audio streams 
have a specific numbering system. Accordingly, by set- 
ting a stream number of one of the audio streams in a 
status register in a playback apparatus so that the play- 
back apparatus selects the audio stream identified by the 
stream number in the status register, the audio stream 
corresponding to the particular codec-language combi- 
nation can be played at each playback session. 
[0004] The status register used here is initializedupon 
factory shipment, and may be updated later by the user. 
[0005] In the above playback apparatus, the status 
register is unchanged unless the user updates it. This 
being so, once the status register has been set to indi- 
cate, for example, AC-3 (2ch), even when content in- 
cludes an AC-3 (5.1ch) audio stream, the AC-3 (5.1 ch) 
audio stream is not played unless the user updates the 
status register. In this case, the AC-3 (5.1 ch) audio 
stream is wasted. To avoid this, it may be suggested to 
provide the playback apparatus with a function of auto- 
matically setting the status register so as to utilize its AC- 
3 (5.1 ch) playback capability. 

[0006] However, not every content contains an AC-3 
(5.1 ch) audio stream. Forexample, anAC-3 (5.1 ch) au- 
diostreamiscertainly included in content of a recent hit 
movie, but may not be included in content of an old movie 
or an art film. If the status register automatic setting func- 
tion operates when playing content that does not include 
an AC-3 (5.1 ch) audio stream, the playback apparatus 
will end up selecting a nonexistent audio stream. 
[0007] Conversely, it may be suggested to store, on a 
BD-ROM carrying an AC-3 (5.1ch) audio stream, infor- 
mation for automatically selecting the AC-3 (5. 1 ch) audio 
stream. However, not every playback apparatus has an 
AC-3 (5.1 ch) decoding capability. If the BD-ROM in- 



structs a playback apparatus without the AC-3 (5.1ch) 
decoding capability to select the AC-3 (5.1ch) audio 
stream, a problem occurs. 

[0008] Thus, since not every content includes an AC- 
5 3 (5. 1 ch) audio stream and not every playback apparatus 
has an AC-3 (5.1ch) decoding capability, the user needs 
to set the status register in order to select an optimal 
audio stream at each playback session. A failure to do 
so often causes an AC-3 (5. 1 ch) audio stream to be wast- 
^0 ed without being played back. 

Disclosure of Invention 

[0009] The present invention aims to provide a play- 
15 back apparatus that performs stream selection so as to 
make full use of advantages of both a recording medium 
and the playback apparatus. 

[0010] The stated aim can be achieved by a playback 
apparatus including: a judgment unit operable to judge, 
20 for each elementary stream, which of a plurality of pre- 
determined conditions the elementary stream satisfies; 
and a playback unit operable to assign a priority to each 
elementary stream according to a pattern of conditions 
the elementary stream satisfies, and select and play back 
25 a highest-priority elementary stream. 

[0011] Each elementary stream is assigned a priority 
depending on which of the plurality of conditions the el- 
ementary stream satisfies. The plurality of conditions re- 
late to a decoding capability of the playback apparatus, 
30 a language setting of the playback apparatus, and a sur- 
round output capability of the playback apparatus. If an 
AC-3 (5.1ch) elementary stream included in the digital 
stream satisfies all of these conditions, the AC-3 (5.1ch) 
elementary stream is assigned a highest priority and se- 
35 lected for playback. If the playback apparatus does not 
have an AC-3 (5.1ch) playback capability, on the other 
hand, an elementary stream that is decodable by the 
playback apparatus and matches the language setting 
of the playback apparatus is selected for playback. 
40 [0012] Thus, a priority is assigned to each audio 
stream depending on which conditions the audio stream 
satisfies, and a highest-priority audio stream is selected 
for playback. This is a shift from a conventional idea of 
simply selecting a playable audio stream, to an idea of 
45 selecting such an audio stream that fully exploits the ca- 
pabilities of the playback apparatus. 

Brief Description of Drawings 

50 [0013] 

FIG. 1 A shows an example of use of a playback ap- 
paratus to which the present invention relates. 
FIG. 1 B shows keys on a remote control 400 for re- 
55 ceiving a user operation on an Interactive Display. 
FIG. 2 shows a structure of a BD-ROM. 
FIG. 3 shows a representation of how an AV Clip is 
formed. 
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FIG. 4 shows a structure of Clip information. 
FIG. 5 sliows a structure of PlayList information. 
FIG. 6 sliows a representation of indirect referencing 
by PlayList information. 

FIG. 7 shows a representation of synchronization of 5 
a SubPlayltem using a sync_Playltem_id and a 
sy n ch_start_PTS_of_P I ay I te m . 
FIG. 8 shows a structure of an STN_table. 
FIG. 9A shows an entry-attribute combination corre- 
sponding to a video stream. 

FIG. 9B shows an entry-attribute combination corre- 
sponding to an audio stream. 
FIG. 9C shows an entry-attribute combination cor- 
responding to a PG stream. 

FIG. 9D shows an entry-attribute combination cor- ^5 
responding to textST stream. 
FIG. 9E shows an entry-attribute combination corre- 
sponding to an IG stream. 

FIG. 10 shows a structure of PlayList information 
preloaded on an HD. 20 
FIG. 11 shows file designation by 
Clip_lnformation_file_names in the PlayList infor- 
mation on the HD. 

FIG. 12 shows an internal construction of the play- 
back apparatus to which the present invention re- 25 
lates. 

FIG. 13 shows detailed settings of PSR1, PSR2, 
PSR15, PSR16, and PSR30. 
FIG. 14 shows detailed settings of PSR4 to PSR8. 
FIG. 1 5A shows status transitions that can be made so 
by PSR1. 

FIG. 15B is a flowchart of "Procedure when playback 

condition is changed" for PSR1 . 

FIG. 1 6 is a flowchart of a detailed procedure of step 

S5. 35 

FIG. 17 shows combinations of playback capabilities 

and stream attributes in a tabular form. 

FIG. 18 shows audio stream selection based on an 

order of entries in an STN_table. 

FIG. 1 9 is a flowchart of "Procedure when change is 

requested" for PSR1 . 

FIGS. 20A to 20c show a first specific example of 

audio stream selection according to "Procedure 

when playback condition is changed". 

FIGS. 21 A to 21c show a second specific example ^5 

of audio stream selection according to "Procedure 

when playback condition is changed". 

FIGS. 22A to 22c show a third specific example of 

audio stream selection according to "Procedure 

when playback condition is changed". 50 

FIG. 23A shows status transitions that can be made 

by PSR2. 

FIG.23B is a flowchart of "Procedure when playback 
condition Is changed" for PSR2. 

FIG. 24 Is a flowchart of "Procedure when change is 55 
requested" for PSR2. 

FIG. 25 is a flowchart of an operation of setting PSR2. 
FIGS. 26A to 26C show a specific example of 



PG_textST_stream selection according to "Proce- 
dure when playback condition is changed". 
FIG. 27 shows PG_textST_stream selection based 
on an order of entries in an STN_table. 
FIG. 28 shows a structure of PlayList information in 
a second embodiment of the present invention. 
FIG. 29 shows a file structure in the second embod- 
iment. 

FIGS. 30A and 308 show multi-angle and non-mul- 

ti-angle blocks. 

FIG. 31 shows detailed settings of PSR3. 

FIG. 32A shows status transitions that can be made 

by PSR3. 

FIG. 328 is a flowchart of "Procedure when playback 
condition is changed" for PSR3. 
FIG. 32C is a flowchart of "Procedure when change 
is requested" for PSR3. 

FIGS. 33A and 338 show how angle blocks are se- 
lected. 

FIG. 34 shows an IG stream and an ICS in the IG 
stream. 

FIG. 35 shows a structure of buttonjnfo. 

FIG. 36 show a relationship between an ICS and 

ODSs in DSn. 

FIG. 37 shows overlaying performed with a presen- 
tation timing of picture data pti . 
FIG. 38 shows status transitions of Buttons 1-A to 
1-D. 

FIG. 39 shows an example of settings of buttonjnfo 
in an ICS. 

FIG. 40 shows display switching from Page 1 to Page 
2. 

FIG. 41 shows detailed settings of PSRO, PSR10, 
and PSR11. 

FIG. 42A shows status transitions that can be made 
by PSRO. 

FIG. 428 is a flowchart of "Procedure when playback 
condition is changed" for PSRO. 
FIG. 43 is a flowchart of "Procedure when change is 
requested" for PSRO. 

FIG. 44 shows an internal structure of an Interactive 
Graphics Decoder 13. 

FIG. 45 is a flowchart of a synchronous control pro- 
cedure using time stamps. 

FIG. 46 is a flowchart of an initial display procedure. 
FIG. 47 is a flowchart of an auto-activation proce- 
dure. 

FIG. 48 is a flowchart of an animation display proce- 
dure. 

FIG. 49 is a flowchart of a button command execution 
procedure. 

FIG. 50 is a flowchart of an UO procedure. 

FIG. 51 is a flowchart of a current button switching 

procedure. 

FIG. 52 shows key operations performed by the user 
when viewing a drama series. 
FIG. 53 shows how Pages 1 to 4 shown in FIG. 52 
are assigned to a selection menu and a chapter 
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menu. 

FIG. 54 shows procedures defined by button com- 
mands to achieve focus shifts. 
FIG. 55 shows focus shifts performed according to 
focus positions on previous Pages. 
FIG. 56 shows bugs that can occur in focus shifts. 
FIG. 57A shows status transitions that can be made 
by PSR11. 

FIG.57B is a flowchart of "Procedure when playbacl< 
condition is changed" for PSR1 1 . 
FIG. 57C is a flowchart of "Procedure when change 
is requested" for PSR11 . 

FIG. 58A shows status transitions that can be made 
by PSR10. 

FIG. 58B is a flowchart of "Procedure when playback 
condition is changed" for PSR10. 
FIG. 59 is a flowchart of "Procedure when change is 
requested" for PSR10. 

Best Mode for Carrying out the Invention 

First Embodiment 

[001 4] The following describes embodiments of a play- 
back apparatus to which the present invention relates. 

First, an example of an act of using the playback appa- 
ratus according to the present invention is explained. 
FIG. 1 shows an example of use of the playback appa- 
ratus according to the present invention. In the drawing, 
the playback apparatus according to the present inven- 
tion is a playback apparatus 200, which constitutes a 
home theater system together with a television 300 and 
a remote control 400. 

[0015] A BD-ROM 100 is used for providing a movie 
film in the home theater system that is constituted by the 
playback apparatus 200, the television 300, and the re- 
mote control 400. 

[0016] The remote control 400 receives a user opera- 
tion directed to the playback apparatus 200. FIG. 1B 
shows keys on the remote control 400 for receiving a 
user operation on an Interactive Display. As illustrated, 
the remote control 400 has a Move Up key, a Move Down 
key, a Move Right key, a Move Left key, an audio switch 
key for receiving an audio switching operation, a subtitle 
switch key for receiving a subtitle switching operation, 
and numeric keys "0" to "9". 

[0017] This concludes the description of the act of us- 
ing the playback apparatus according to the present in- 
vention. 

[0018] The BD-ROM which is a recording medium to 
be played back by the playback apparatus according to 
the present invention is described next. FIG. 2 shows a 
structure of the BD-ROM. In the drawing, the fourth level 
shows the BD-ROM, and the third level shows a track on 
the BD-ROM. The track is shown as being stretched out 
into a straight line, though in actuality the track spirals 
outwards from the center of the BD-ROM. The track in- 
cludes a lead-in area, a volume area, and a lead-out area. 



The volume area has a layer model of a physical layer, 
a file system layer, and an application layer. The first 
level shows a format of the application layer (application 
format) of the BD-ROM in a directory structure. As illus- 

5 trated, the BD-ROM has a BDMV directory below a 
ROOT directory. The BDMV directory contains files such 
as YYY.MPLS, XXX. CLPI, XXX.M2TS, ZZZ.M2TS, and 
ZZZ.CLPI. The XXX.M2TS file corresponds to an AV 
Clip, and the XXX. CLPI file corresponds to Clip informa- 

10 tion. 

[001 9] The recording medium according to the present 
invention can be realized by generating such an applica- 
tion format. 

15 <Structure of the AV Clip> 

[0020] The AV Clip which is one of the components 
(AV Clip and Clip information) of content of the movie 
film is described below. 
20 [0021] FIG. 3 shows a representation of how the AV 
Clip is formed. 

[0022] The AV Clip (middle level) can be created as 
follows. A video streammade up of a plurality of video 
frames (pictures pj1, pj 2, pj3, ...) and an audio stream 

25 made up of a plurality of audio frames (upper first level) 
are each converted to PES packets (upper second level), 
and further converted to TS packets (upper third level). 
Likewise, a Presentation graphics stream (PG stream) 
for subtitles and an Interactive graphic stream (IG 

30 stream) for Interactive Displays (lower first level) are con- 
verted to PES packets (lower second level), and further 
converted to TS packets (lower third level). These TS 
packets of the video, audio, and PG and IG streams are 
then multiplexed to form the AV Clip. 

35 [0023] Here, not only the PG stream multiplexed in the 
AV Clip but also a textST stream forms subtitles. The 
textST stream is a data string that represents subtitles 
by text data. The textST stream is called a subClip, and 
is recorded on the BD-ROM or an HD in the playback 

40 apparatus by a filename different from that of the AV Clip. 
The PG stream and the textST stream which form sub- 
titles are both called a PG_textST_stream. This con- 
cludes the description of the AV Clip. 



[0024] The following describes the XXX. CLPI file. 
[0025] The Clip information (XXX. CLPI) is manage- 
ment information for the individual AV Clip. FIG. 4 shows 

50 a structure of the Clip information. Dotted guidelines in 
the drawing indicate the structure of the Clip information 
in more detail. As indicated by guideline hn1, the Clip 
information (XXX.CLPI) includes Program. Info and an 
EP_map used for searching the video stream for a start 

55 of an I picture. 

[0026] The Program. Info is information showing a PID 
and an attribute of each individual elementary stream 
multiplexed in the AV Clip, in association with a 



45 <Structure of the Clip lnformation> 
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Stream_index. The Streamjndex is an index of eacli 
individual elementary stream multiplexed in the AV Clip 
corresponding to this Clip information. PIDs of the indi- 
vidual elementary streams identified by Streamjndices 
are shown in Stream_PID [Streamjndex] entries indi- 
cated by guideline hn2. 

[0027] Also, attributes of the individual elementary 
streams identified by the Streamjndices are shown in 
Stream_Attribute [Streamjndex] entries indicated by 

guideline hn3. The attributes include video attributes, au- 
dio attributes, and graphics attributes. The video at- 
tributes show a method used for compressing a video 
stream (Coding), a resolution of picture data which com- 
poses the video stream (Resolution), an aspect ratio of 
the picture data (Aspect) , a frame rate of the picture data 
(Framerate) , and the like. The audio attributes show a 
method used for compressing an audio stream (Coding), 
a channel attribute of the audio stream (Ch.), a language 
attribute of the audio stream (Lang) , and the like . 
Through the use of a streamjndex, an attribute of an 
elementary stream can be retrieved from the Program. I n- 
fo. 

[0028] The EP_map is a reference table for indirect 
referencing of addresses of a plurality of locations to 
which a skip operation is likely to be made, using time 
information. As indicated by guideline hn5, the EP_map 
includes a plurality of entries (ACCESS UNIT #1 entry, 
ACCESS UNIT #2 entry, ACCESS UNIT #3 entry, ...) 
and the number of entries (Number) . 
[0029] As indicated by guideline hn6, each of the en- 
tries shows a playback start time of a corresponding I 
picture, together with an address of the I picture and a 
size of the I picture (l-Size). The playback start time of 
the I picture is expressed using a time stamp (Presenta- 
tion Time Stamp) of the I picture. The address of the I 
picture is expressed using a serial number (SPN (Source 
Packet Number)) of a TS packet corresponding to the I 
picture. It should be noted here that the filename XXX of 
the Clip information XXX.CLPI is the same as the filena- 
me of the AV Clip corresponding to the Clip information. 
Which is to say, the filename XXX of the Clip information 
in FIG. 4 means the Clip information corresponds to the 
AV Clip XXX. M2TS . This concludes the description of 
the Clip information. 

<ZZZ.M2TS and ZZZ.CLPI> 

[0030] The following describes the ZZZ.M2TS file and 
the ZZZ.CLPI file. The subClip (ZZZ.M2TS) is a file stor- 
ing a stream that is played synchronously with the AV 
Clip. A representative of such a subClip is the aforemen- 
tioned textST stream. Other subClips include an audio 
stream and an IG stream. The AV Clip shown in FIG. 3 
is hereafter also called a main Clip, to distinguish it from 
the subClip. 

[0031] The Clip information (ZZZ.CLPI) is Clip infor- 
mation corresponding to the subClip. 



<Structure of the PlayList information> 

[0032] The following describes the YYY.MPLS file. 
The PlayList information (YYY.MPLS) is information 

5 which defines a combination of two types of playback 
paths that are a main path and a SubPath, as a PlayList 
(PL). FIG. 5 shows a data structure of the PlayList infor- 
mation. As shown in the drawing, the PlayList information 
includes Playltem information #1, #2, ... , #m for defining 

^0 the main path and SubPath information #1, #2, ... , #p 
each for defining the SubPath. 

[0033] The main path is a playback path defined on an 

AV Clip which is the main Clip, whereas the SubPath is 
a playback path defined on a subClip. 

^5 [0034] The main path is explained first. The main path 
is defined by a plurality of sets of Playltem information 
(Playltem information #1 , #2, #3, ... , #m) and the number 
of sets of Playltem information (Number) . Playltem in- 
formation defines at least one logical playback section 

20 included in the main path. Guideline hs1 indicates a de- 
tailed structure of the Playltem information. As illustrated, 
the Playltem information includes a 
Clip_lnformationJile_name field showing a filename of 
Clip information of the AV Clip to which an IN point and 

25 an OUT point of the playback section belong, a 
Clip_codecJdentifier field showing a coding method of 
the AV Clip, an INJime field which is time information 
indicating a start of the playback section, an OUTJime 
field which is time information indicating an end of the 

30 playback section, and an STNJable field showing, 
among the elementary streams in the AV Clip and its 
related subClip, elementary streams from which the play- 
back apparatus can select for presentation of the Play- 
ltem. 

35 [0035] The Playltem information has a feature of being 
written based on conversion from time information to an 
addresses. In other words, the playback section is de- 
fined in the form of indirect referencing that uses the 
EP_map as a reference table. FIG. 6 shows a represen- 
"^0 tation of indirect referencing by PlayList information. In 
the drawing, the AV Clip is composed of a plurality of TS 
packets. The EP_map in the Clip information specifies 
sector addresses of TS packets that correspond to starts 
of I pictures, as indicated by arrows ay1 , ay2, ayS, ay4, .... 
^5 Arrows jy1, jy2, jy3, jy4, ... indicate a representation of 
referencing of TS packets by Playltem information. It can 
be understood from the drawing that the referencing by 
the Playltem information (indicated by arrows jy1 , jy2, 
jyS, jy4, ...) is indirect referencing that specifies address- 
ee es of TS packets in the AV Clip through the EP_map. 
[0036] A playback section on the BD-ROM, which is 
obtained by a combination of Playltem information. Clip 
information, and an AV Clip, is called a Playltem. The 
movie film recorded on the BD-ROM is composed of Play- 
er Items. Since the movie film recorded on the BD-ROM is 
composed of logical playback units, "sharing", i.e. an AV 
Clip which forms a scene of one movie filmbeing refer- 
enced by another movie film, can be efficiently conduct- 
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ed. 

[0037] The variation in movie films can be widened just 
by defining various kinds of PlayList information, wliich 
enables movie film producers to extend the range of ex- 
pression. This is a greatest advantage of static scenario. 
Playback units of BD-ROMs include not only a Playltem 
but also a Title and a Chapter. The Title is a playback 
unit corresponding to one movie film, and is composed 
of at least one set of PlayList information. The Chapter 
is a playback unit corresponding to one chapter of a mov- 
ie film, and is defined by information called Mark infor- 
mation. 

[0038] The filename YYY of the PlayList information 
represents a three-digit ID number assigned to the Play- 
List information in the BD-ROM. Which is to say, the Play- 
List information shown in FIG. 6 is uniquely identified by 
this ID number YYY. The use of "YYY" as the ID number 
of the PlayList information indicates that the ID number 
of the PlayList information has a different numbering sys- 
tem from the ID number XXX of the AV Clip and the Clip 
information (though the number of digits of the I D number 
is three in this example, the number of digits is not limited 
to such). 

[0039] This concludes the description of the main path. 
The SubPath is described next. 

<SubPath> 

[0040] Guideline hc1 in FIG. 5 indicates a structure of 
SubPath information in detail. As illustrated, the SubPath 
information is made up of at least one set of SubPlayltem 
information. SubPlayltem information includes a 
Clip_lnformation_file_name field, a Clip_codec_identi- 
fier field, a SubPlayltem_IN_time field, a SubPlayltem_ 
OUT_time field, a sync_Playltem_id field, and a 
sync_start_PTS_of_Playltem field, as indicated by 
guideline hc2. 

[0041] The Clip_lnformation_file_name field shows a 
filename of Clip information of a subClip corresponding 
to the SubPlayltem, to thereby uniquely identify the sub- 
Clip. 

[0042] The Clip_codec_identifier field shows a coding 
method of the subClip. 

[0043] The SubPlayltem_IN_time field is time informa- 
tion indicating a start of the SubPlayltem on a playback 
time axis of the subClip. 

[0044] The SubPlayltem_OUT_time field is time infor- 
mation indicating an end of the SubPlayltem on the play- 
back time axis of the subClip. 

[0045] The sync_Playltem_id field uniquely identifies 
one of the Playltems in the main path with which the 
SubPlayltem is to be synchronized. The SubPlayltem_ 
IN_time is presenton a playbacktime axis of the Playltem 
identified by the sync_Playltem_id. 
[0046] The sync_start_PTS_of_Playltem field speci- 
fies the start of the SubPlayltem indicated by the 
SubPlayltem_IN_time, on the playback time axis of the 
Playltem identified by the sync_Playltem_id. When the 



current playback time has reached a point specified by 
this sync_start_PTS_of_Playltem on the playback time 
axis of the Playltem, the playback of the SubPlayltem is 
launched. 

5 [0047] FIG. 7 shows a representation of synchroniza- 
tion of the SubPlayltem according to the sync_Playltem_ 
id and the sync_start_PTS_of_P lay Item. In the drawing, 
the main path is made up of Playltems #1 , #2, and #3. 
The sync_Playltem_id and the sync_start_PTS_of_ 

10 Playltem of the SubPlayltem which forms a SubPath are 
set as shown in dotted box wh1. In detail, the 
sync_Playltem_id is set to specify Playltem #1 , and the 
sync_start_PTS_of_Playltem is set to specify time t1 on 
the playback time axis of Playltem #1. This being the 

15 case, when the current playback time has reached t1 on 
the playback time axis of Playltem #1 , playback of a part 
of the subClip (textST stream), specified by the 
Clip_lnformation_file_name, from the SubPlayltem_IN_ 
time to the SubPlayltem_OUT_time is launched. As a 

20 result, the part of the textST stream from the 
SubPlayltem_IN_time to the SubPlayltem_OUT_time is 
played synchronously with the AV Clip. This concludes 
the description of the SubPath information. 
[0048] The STN_table field included in the Playltem 

25 information described above provides information used 
for status settings, and is an essential feature of the 
present invention. The following describes the 
STN table in detail. 



[0049] The STN_table shows elementary streams 
available for presentation, among elementary streams 
multiplexed in the AV Clip specified by the Clip_ 

35 lnformation_file_name of the Playltem and elementary 
streams in a subClip specified by the Clip_ 
lnformation_file_name of a SubPlayltem relating to the 
Playltem. The STN_table is formed by associating an 
entry of each elementary stream with its attribute. An 
elementary stream available for presentation is mainly 
an elementary stream multiplexed in the AV Clip speci- 
fied by the Playltem, but may also include an elementary 
stream (textST stream) recorded separately from the AV 
Clip but played together with the AV Clip. 

45 [0050] FIG. 8 shows a structure of the STN_table. As 
shown in the drawing, the STN_table includes a plurality 
of combinations of entries and attributes (entry-attribute), 
and the numbers of entry-attribute combinations 
(number_of_video_stream_entries, 

50 number_of_audio_stream_entries, 

n u mbe r_of_P G_textST_st ream_e ntr ies , and 
number_of_IG_stream_entries) . 
[0051 ] The entry-attribute combinations correspond to 
a video stream, audio streams, PG_textST_streams, and 

55 IG streams that are available for presentation in the Play- 
ltem, as indicated by the parenthesis "{". 
[0052] The entry-attribute combinations are explained 
in detail below. FIGS. 9A to 9D show the entry-attribute 
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combinations in detail. 

[0053] FIG. 9A shows an entry-attribute combination 
corresponding to a video stream. 
[0054] An entry in this entry-attribute combination cor- 
responding to the video stream includes a ref_to_ 
stream_PID_of_mainClip field showing a PID used for 
extracting the video stream when demultiplexing the AV 
Clip. 

[0055] An attribute in the entry-attribute combination 
corresponding to the video stream includes a stream_ 
coding_type field which is set to 0x02, and a frame_rate 
field showing a display rate of the video stream. 
[0056] FIG. 9B shows an entry-attribute combination 
corresponding to an audio stream. 
[0057] An entry in the entry-attribute combination cor- 
responding to the audio stream includes a ref_to_ 
stream_PID_of_mainClip field showing a PID used for 
extracting the audio stream when demultiplexing the AV 
Clip. 

[0058] An attribute in the entry-attribute combination 
corresponding to the audio stream includes a stream_ 
coding type field which is set to one of 0x80 (Linear 

PCM) , 0x81 (AC-3), and 0x82 (DTS) to indicate a coding 
type of the audio stream, an audio _presentation_type 
field showing a channel structure of the audio stream and 

indicating whether surround output is possible, and an 
audio_language_code field showing a language attribute 
of the audio stream. 

[0059] FIG. 9C shows an entry-attribute combination 
corresponding to a PG stream. 

[0060] An entry in the entry-attribute combination cor- 
responding to the PG stream includes a ref_to_ 
stream_PID_of_mainClip field showing a PID used for 
extracting the PG stream when demultiplexing the AV 
Clip. 

[0061] An attribute in the entry-attribute combination 
corresponding to the PG stream includes a stream_ 
coding_type field which is set to 0x90 indicating a PG 
stream codec, and a PG_language_code field showing 
a language attribute of the PG stream. 
[0062] FIG. 9D shows an entry-attribute combination 
corresponding to a textST stream. 
[0063] An entry in the entry-attribute combination cor- 
responding to the textST stream includes a ref_to_ 
subClip_entry_id field showing an entry identifier of a 
subClip storing the textST stream, a ref_to_SubPath_id 
field showing an ID of SubPath information, and a 

ref_to_stream_PID ^of_subClip field showing a PID of 

the textST stream. 

[0064] An attribute in the entry-attribute combination 
corresponding to the textST stream includes a stream_ 
coding_type field which is set to 0x92 indicating a textST 
stream codec, a character_code field showing a charac- 
ter code of the textST stream, and a textST_ 
language_code field showing a language attribute of the 
textST stream. 

[0065] FIG. 9E shows an entry-attribute combination 
corresponding to an IG stream. 



[0066] An entry in the entry-attribute combination cor- 
responding to the IG stream includes a ref_to_ 
stream_PID_of_mainClip field showing a PID used for 
extracting the IG stream when demultiplexing the AV 
5 Clip. 

[0067] An attribute in the entry-attribute combination 
corresponding to the IG stream Includes a stream_ 
coding_type field which is set to 0x91 indicating an IG 
stream codec, and an IG_language_code field showing 
a language attribute of the IG stream. This concludes the 
description of the data structure of the entry-attribute 
combination of each elementary stream. The order of 
entries in the STN_table is interpreted as the order of 
priorities in stream selection. Also, entries of textST 

15 streams and PG streams are put in one group in the 
STN_table in orderto treatthe PG streams and the textST 
streams on an equal basis and determine which stream 
out of the PG streams and the textST streams has a 
higher priority. For example, if a textST stream has a 

20 higher entry than a PG stream in the group of entries for 
PG_textST_streams in the STN_table, the textST stream 
is selected over the PG stream. Conversely, if the PG 
stream has a higher entry than the textST stream in the 
STN_table, the PG stream is selected over the textST 

25 stream. 

[0068] The above STN_table is provided for each set 
of PlayList information. Therefore, there may be a case 
where an entry of one elementary stream is high in an 
STN_table of one set of PlayList information but low in 

30 an STN_table of another set of PlayList information. 
[0069] This concludes the description of the data struc- 
ture of the application format in the BD-ROM. It should 
be noted here that the recording medium to be played 
back by the playback apparatus according to the present 

35 invention is not limited to the BD-ROM, but also includes 
the HD in the playback apparatus. Data recorded on the 
HD is explained below. The HD stores a file containing 
a subClip, a file containing Clip information, and a file 
containing PlayList information, too. These files are 

^0 preloaded onto the HD via a network. FIG. 10 shows a 
structure of such preloaded PlayList information. As 
shown in the drawing, the preloaded PlayList information 
has a similar structure to the PlayList information on the 
BD-ROM shown in FIG. 5. The difference from the one 

^5 shown in FIG. 5 lies in that a Clip_lnformation_file_name 
in Play Item information and a Clip_lnformation_ 
file_name in SubPlayltem information can each desig- 
nate Clip information on any of the BD-ROM and the HD. 
To designate Clip information on the BD-ROM, a full path 

50 of a file on the BD-ROM needs not be used in the preload- 
ed PlayList information. This is because the playback 
apparatus recognizes the BD-ROM and the HD together 
as one virtual drive (called a virtual package). Accord- 
ingly, a Clip_lnformation_file_name in Playltem informa- 

55 tion and a Clip_lnformation_file_name in SubPlayltem 
information in the preloaded PlayList information can 
designate an AV Clip on any of the HD and BD-ROM, by 
using a file body, such as XXX or ZZZ, of a file containing 
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Clip information. FIG. 1 1 shows designation of files by 
Clip_lnformation_file_names in PlayList information on 
the HD. In the drawing, arrows rfl, rf2, and rf3 indicate 
file designation by Clip_lnformation_file_names in Play- 
Item information in the PlayList information, and arrows 
pf1, pf2, and pf3 indicate file designation by Clip_ 
lnformation_file_names in SubPlayltem information in 
the PlayList information. Through such file designation 
by Clip_lnformation_file_names, a SubPath defined on 
a subClip on the HD can be played synchronously with 
a main path defined on a main Clip on the BD-ROM. 
[0070] Note that the data structures explained above 
are instances of class structures written in a program- 
ming language. The author writes the class structures to 
create these data structures on the BD-ROM. 
[0071 ] This concludes the description of the recording 
medium. The following describes the pi aybacl< apparatus 
according to the present invention. FIG. 12 shows an 
internal construction of the playback apparatus accord- 
ing to the present invention. The playbacl< apparatus ac- 
cording to the present invention is manufactured based 
on this internal construction. The playback apparatus is 
roughly made up of two parts that are a system LSI and 
a drive device. The playback apparatus can be manu- 
factured by mounting these parts on a cabinet and sub- 
strate of the apparatus. The system LSI is an integrated 
circuit including various processing units for achieving 
the functions of the playback apparatus. The playback 
apparatus includes a BD drive 1 , a Read Buffer 2, a De- 
multiplexer 3, a Video Decoder 4, a Video Plane 5, a 
Presentation Graphics Decoder 9, a Presentation Graph- 
ics Plane 10, an adder 11, a Font Generator 12, an In- 
teractive Graphics Decoder 13, a switch 14, an Interac- 
tive Graphics Plane 1 5, an adder 1 6, an HDD 1 7, a Read 
Buffer 18, a Demultiplexer 19, an Audio Decoder 20, a 
scenario memory 23, a control unit 24, a switch 25, a 
CLUT unit 26, a CLUT unit 27, a PSR set 28, and an 
operation reception unit 29. The control unit 24 includes 
a transition control unit 30. 

[0072] The BD drive 1 performs loading and ejecting 
of the BD-ROM, and accesses to the BD-ROM. 
[0073] The Read Buffer 2 is a FIFO memory. Accord- 
ingly, TS packets read from the BD-ROM are removed 
from the Read Buffer 2 in a same order as they arrive. 
[0074] The Demultiplexer (Demux) 3 reads TS packets 
from the Read Buffer 2 and converts the TS packets to 
PES packets. The Demultiplexer 3 outputs PES packets 
having a stream ID designated by the control unit 24 to 
one of the Video Decoder 4, the Audio Decoder 20, the 
Presentation Graphics Decoder 9, and the Interactive 
Graphics Decoder 13. 

[0075] The Video Decoder 4 decodes PES packets 
output from the Demultiplexer 3 to obtain uncompressed 
pictures, and writes the uncompressed pictures to the 
Video Plane 5. 

[0076] The Video Plane 5 is a plane for storing uncom- 
pressed pictures. Here, a plane is a memory area used 
for storing one screen of pixel data in the playback ap- 



paratus. By providing the playback apparatus with a plu- 
rality of planes and adding the storage contents of these 
planes for corresponding pixels, an image output in which 
a plurality of images are overlaid on each other can be 

5 produced. The Video Plane 5 has a resolution of 1920 
X 1 080, and picture data stored on the Video Plane 5 is 
composed of pixel data expressed by 1 6-bit YUV values. 
[0077] The Presentation Graphics Decoder 9 decodes 
a graphics stream read from the BD-ROM or the HD to 

10 obtain uncompressed graphics, and writes the uncom- 
pressed graphics to the Presentation Graphics Plane 1 0. 
As a result of decoding the graphics stream, subtitles are 
displayed on the screen. 

[0078] The Presentation Graphics Plane 10 is a mem- 
^5 ory having one screen of area, and is capable of storing 
one screen of uncompressed graphics. The Presentation 
Graphics Plane 10 has a resolution of 1920 x 1080, and 
each pixel in the uncompressed graphics on the Presen- 
tation Graphics Plane 10 is expressed by an 8-bit index 
20 color. By converting the index color using a CLUT (Color 
Lookup Table), the uncompressed graphics on the Pres- 
entation Graphics Plane 10 is presented for display. 
[0079] The adder 1 1 overlays the storage contents of 
the Presentation Graphics Plane 10 on uncompressed 
25 picture data (i) . 

[0080] The Font Generator 12 develops text code in- 
cluded in a textST stream to a bitmap, using a character 
font. 

[0081] The Interactive Graphics Decoder 13 decodes 

30 an IG stream read from the BD-ROM or the HD to obtain 
uncompressed graphics, and writes the uncompressed 
graphics to the Interactive Graphics Plane 15. 
[0082] The switch 14 selectively writes one of a font 
string generated by the Font Generator 12 and graphics 

35 generated by the Presentation Graphics Decoder 9, to 
the Presentation Graphics Plane 10. 
[0083] The Interactive Graphics Plane 15 is used for 
storing uncompressed graphics obtained by the Interac- 
tive Graphics Decoder 13. 

40 [0084] The adder 1 6 overlays the storage contents of 
the Interactive Graphics Plane 15, on picture data (ii) 
which is generated by overlaying the storage contents of 
the Presentation Graphics Plane 10 on the uncom- 
pressed picture data (i). 

45 [0085] The H DD 1 7 is the aforementioned HD included 
in the playback apparatus. By reading the storage con- 
tents of the HDD 17 and dynamically combining them 
with the storage contents of the BD-ROM, a graphics 
stream or a textST streamnot recorded on the BD-ROM 

50 can be presented. 

[0086] The Read Buffer 1 8 is a Fl FO memory. Accord- 
ingly, TS packets read from the HDD 17 are removed 
from the Read Buffer 1 8 in the same order as they arrive. 
[0087] The Demultiplexer (Demux) 19 reads TS pack- 

55 ets from the Read Buffer 1 8 and converts the TS packets 
to PES packets. The Demultiplexer 1 9 outputs PES pack- 
ets having a stream I D designated by the control unit 24, 
to the Font Generator 12. 
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[0088] The Audio Decoder 20 decodes PES packets 
output from the Demultiplexer 3, and outputs uncom- 
pressed audio data. 

[0089] The scenario memory 23 is used for storing cur- 
rent PlayList information and current Clip information. 
The current PlayList information refers to PlayList infor- 
mation that relates to the current playbacl<, among a plu- 
rality of sets of PlayList information recorded on the 
BD-ROM. The current Clip information refers to Clip in- 
formation that relates to the current playback, among a 
plurality of sets of Clip information recorded on the 
BD-ROIVI. 

[0090] The control unit 24 controls reading of an AV 
Clip from the BD-ROM and playback of the AV Clip, ac- 
cording to the current PlayList information and the current 
Clip information on the scenario memory 23. In detail, 
the control unit 24 detects the current Playltem in the 
current PlayList information. With reference to the current 
Clip information identified by a Clip_lnformation_ 
file_name of the current Playltem, the control unit 24 con- 
trols the BD-ROM drive 1 to read TS packets from an 
IN_timeto an OUT_time of the current Playltem, from an 
AV Clip specified by the current Clip information. The 
read TS packets are output selectively to the Video De- 
coder 4, the Presentation Graphics Decoder 9, the Inter- 
active Graphics Decoder 13, and the Audio Decoder 20 
via the Demultiplexer 3, to play the AV Clip. 
[0091] If the current PlayList information includes a 
SubPlayltem to be synchronized with the current Play- 
ltem, the control unit 24 plays a subClip specif iedby the 
SubPlayltem synchronously with the main Clip. This syn- 
chronization is conducted by playing back data from a 
SubPlayltem_IN_time to a Sub Play ltem_OUT_time of 
the SubPlayltem when picture data corresponding to a 
sync_start_PTS_of_Playltem of the SubPlayltem is read 
from the main Clip. 

[0092] The switch 25 selectively feeds various data 
read from the BD-ROM and the HD to the Read Buffer 
2, the Read Buffer 18, and the scenario memory 23. 
[0093] The CLUT unit 26 converts index colors of the 
uncompressed graphics stored on the Video Plane 5, to 
Y, Cr, and Cb values. 

[0094] The CLUT unit 27 converts index colors of the 
uncompressed graphics stored on the Interactive Graph- 
ics Plane 15, to Y, Cr, and Cb values. 
[0095] The PSR set 28 is a register equipped in the 
playback apparatus, and is composed of 64 Player Status 
Registers (PSRs) and 4096 General Purpose Registers 
(GPRs). A definition of a value of each PSR will be ex- 
plained in detail later. 

[0096] The operation reception unit 29 outputs, when 
an operation of selecting a stream or the like is made on 
the remote control or a front panel of the playback appa- 
ratus, user operation information indicating the operation 
to the control unit 24. 

[0097] The transition control unit 30 is included in the 
control unit 24. The transition control unit 30 extracts a 
stream_PID of an entry-attribute combination corre- 



sponding to a PSR from an STN_table in the current Play- 
ltem information, and outputs the extracted stream_PID 
to the Demultiplexer 3 or 19. Since the setting of the 
Stream_PID in the Demultiplexer 3 or 1 9 is based on the 
5 PSR, the transition control unit 30 performs a setting op- 
eration on the PSR in accordance with a condition change 
in or a change request to the playback apparatus. 
[0098] In detail, when a condition change occurs in the 
playback apparatus, the transition control unit 30 judges 
whether a value of the PSR is Valid, Invalid, or undefined. 
If the value is Valid, the transition control unit 30 maintains 
the value. If the value is I nvalid or undefined, the transition 
control unit 30 sets an optimal value in the PSR. 
[0099] When a change of the PSR is requested by user 
operation information output from the operation reception 
unit 29 or a button command output from the Interactive 
Graphics Decoder 13, the transition control unit 30 de- 
termines a value (value X) to be set in the PSR according 
to the user operation information or the button command, 
and performs a PSR update operation based on value 
X. If the user operation information indicates that the au- 
dio switch key or the subtitle switch keyhas been pressed, 
the transition control unit 30 determines a sum of the 
PSR and 1 as value X. If the user operation information 
indicates that one of the numeric keys has been pressed, 
the transition control unit 30 determines a number cor- 
responding to the pressed numeric key as value X. If the 
button command instructs to set the PSR, on the other 
hand, the transition control unit 30 determines a value 
specified by an argument of the button command as value 
X. Once value X has been determined in this way, the 
transition control unit 30 judges whether value X is Valid, 
Invalid, or undefined, and performs a PSR update oper- 
ation depending on a result of the judgment. In detail, if 
value X is Valid, the transition control unit 30 overwrites 
the PSR with value X. If value X is undefined, the transi- 
tion control unit 30 selects an optimal value and sets the 
optimal value in the PSR. If value X is Invalid, the tran- 
sition control unit 30 maintains the value of the PSR. 

<PSRs> 

[01 00] This concludes the description of the construc- 
tion of the playback apparatus according to the present 
invention. The following describes individual PSRs in the 
PSR set 28. In the PSR set 28, PSR1, PSR2, PSR15, 
PSR1 6, and PSR30 relate to selection of audio and sub- 
titles, capabilities of decoding and presenting audio and 
subtitles, and a language setting in the playback appa- 
ratus. FIG. 13 shows detailed settings of PSR1, PSR2, 
PSR15, PSR16, and PSR30. 

[0101] PSR1 specifies an audio stream currently se- 
lected by the playback apparatus. 
[0102] PSR2 includes a disp_flag field, and specifies 
a PG_textST_stream currently selected by the playback 
apparatus. The disp_flag field is set to 0 to indicate that 
display of a PG stream and a textST stream is disabled, 
and 1 to indicate that display of a PG stream and a textST 
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stream is enabled. 

[0103] PSR15 includes an LPCIVl capability field, an 
AC-3 capability field, and a DTS capability field. The 
LPCM capability field is set to 0001 ^ to indicate that the 
playback apparatus is capable of playing LPCM stereo, 
and 001 0^ to indicate that the playback apparatus is ca- 
pable of playing LPCM surround. 

[0104] The AC-3 capability field is set to 0001 ^ to in- 
dicate that the playback apparatus is capable of playing 
AC-3 stereo, and 001 0^ to indicate that the playback ap- 
paratus is capable of playing AC-3 surround. 
[0105] The DTS capability field is set to 0001 ^ to indi- 
cate that the playback apparatus is capable of playing 
DTS stereo, 001 0^ to indicate that the playback appara- 
tus is capable of playing DTS surround, and 0000^ to 
indicate that the playback apparatus is incapable of de- 
coding a DTS audio stream. 

[0106] PSR16 is set to a value other than OxFFF to 
indicate an audio stream language attribute, and set to 
OxFFF to indicate that no audio stream language attribute 
is specified. 

[0107] A most significant bit of PSR30 is set to 0 to 
indicate that the playback apparatus is incapable of dis- 
playing text subtitles, and set to 1 to indicate that the 
playback apparatus is capable of displaying text subtitles. 
[0108] This concludes the explanation of FIG. 13. The 
following describes PSR4 to PSR8 with reference to FIG. 
14. FIG. 14 shows detailed settings of PSR4 to PSR8. 
[0109] PSR4 is set to one of the values 1 to 100 to 
indicate a number of a Title corresponding to the current 
playback time, and set to 0 to indicate that the current 
playback time corresponds to a top menu. 
[0110] PSR5 is set to one of the values 1 to 999 to 
indicate a number of a Chapter corresponding to the cur- 
rent playback time, and set to OxFFFF to indicate that a 
Chapter number is invalid in the playback apparatus. 
[0111] PSR6 is set to one of the values 0 to 999 to 
indicate a number of a PlayList corresponding to the cur- 
rent playback time (current PlayList). 
[0112] PSR7 is set to one of the values 0 to 255 to 
indicate a number of a Playltem corresponding to the 
current playback time (current Playltem). 
[0113] PSR8 is set to one of the values 0 to 
OxFFFFFFFF to indicate the current playback time with 
a time accuracy of 45 KHz (current PTM). This concludes 
the explanation of PSR4 to PSR8. 

<Status transitions of PSR1> 

[0114] The following describes status transitions of 
PSR1 in detail. 

[0115] PSR1 specifies one of a plurality of audio 
streams which are listed as entries in the STN_table of 
the current Playltem. When PSR1 changes, the playback 
apparatus plays back an audio stream specified by the 
changed PSR1 . PSR1 is initially set to OxFF, and can be 
reset to any of the values 1 to 32 by the playback appa- 
ratus. The value OxFF is an undefined value, indicating 



that no audio stream is present or no audio stream is 
selected. The values 1 to 32 are interpreted as audio 
stream numbers. 

[0116] FIG. 15A shows status transitions that can be 
5 made by PSR1 . In the drawing, the term "Valid" denotes 
a state where PSR1 is no greater than the number of 
entries in the STN_table of the current Playltem and also 
the playback apparatus is capable of playing the audio 
stream. 

fo [0117] Meanwhile, the term "Invalid" denotes a state 
where PSR1 is 0 or greater than the number of entries 
in the STN_table of the current Playltem. There may be 
a case where even if PSR1 is no greater than the number 
of entries in the STN_table of the current Playltem, the 

15 playback apparatus is incapable of decoding the audio 
stream. 

[0118] Procedures for setting PSR1 upon a status tran- 
sition are schematically shown in dotted boxes in FIG. 
15A. There are two types of PSR setting procedures, 

20 namely, "Procedure when playback condition is 
changed" and "Procedure when change is requested". 
[0119] "Procedure when playback condition is 
changed" is a procedure to run when the condition of the 
playback apparatus changes due to the occurrence of 

25 some kind of event. 

[0120] "Procedure when YYY change is requested" is 
a procedure to run when the user requests some kind of 
change (stream change in the case of FIG. 15). 
[0121] "Procedure when playback condition is 

30 changed" and "Procedure when change is requested" 
shown in the dotted boxes are the stream selection pro- 
cedures that constitute the principal features of the 
present invention, and will be explained in detail later with 
reference to flowcharts. 

35 [0122] Each arrow in FIG. 15A represents a status 
transition of PSR1. 

[01 23] A comment accompanying each arrow denotes 
an event which triggers a status transition. In detail, when 
any of "Load a disc", " Change a Stream", "Start PlayList 
playback", "Cross a Playltem boundary", and "Terminate 
PlayList playback" occurs, PSR1 undergoes a status 
transition. In view of this notation, it can be understood 
from FIG. 15A that none of the above procedures is per- 
formed upon a status transition from Invalid to Invalid and 

^5 a status transition from Valid to I nvalid. On the other hand, 
each of a status transition from Invalid to Valid and a 
status transition from Valid to Valid passes one of the 
procedures. In other words, to set Valid PSR1, "Proce- 
dure when playback condition is changed" or "Procedure 

50 when change is requested" is carried out. 

[0124] The events which trigger status transitions are 
explained below. 

[0125] "Loadadisc" is an eventof loading the BD-ROM 
to the playback apparatus. Upon loading, PSR1 is initially 
55 set to an undefined value (OxFF). 

[01 26] "Start PlayList playback" is an event of starting 
playback based on a PlayList. When this event occurs, 
"Procedure when playback condition is changed" is per- 
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formed, and PSR1 becomes Valid. 
[0127] "Terminate PlayList playback" is an event of 
ending playback based on a PlayList. When this event 
occurs, "Procedure when playback condition is changed" 
is not performed, and PSR1 becomes Invalid. 
[0128] "Change XXX" is an event of receiving a user 
request to switch XXX (stream in the case of FIG. 15) . 
When this event occurs while PSR1 is Invalid (Cj1 in FIG. 
15A) , PSR1 issettoa value requested by the user. Even 
if thissetvalueshowsavalidaudiostream number, PSR1 
is treated as Invalid. Thus, a PSR which is Invalid never 
changes to Valid by "Change XXX". 
[0129] When "Change a Stream" occurs while PSR1 
is Valid (Cj2) , on the other hand, "Procedure when 
change is requested" is performed and a new value is 
assigned to PSR1. The value assigned to PSR1 here 
may not be the value requested by the user. This is be- 
cause "Procedure when change is requested" has a func- 
tion of excluding an invalid value. PSR1 which is Valid 
never changes to Invalid by "Change a Stream", since 
"Procedure when change is requested" ensures not to 
make PSR1 Invalid. 

[01 30] "Cross a Playltem boundary" is an event where 
playback crosses over a Playltem boundary. The Play- 
ltem boundary refers to here is a point between an end 
of one Playltem and a beginning of an immediately suc- 
ceeding Playltem. When this event occurs while PSR1 
is Valid, "Procedure when playback condition is changed" 
is performed. After "Procedure when playback condition 
is changed", PSR1 either returns to Valid or moves to 
Invalid. Since an STN_table is provided for each Play- 
ltem, playable elementary streams change when the cur- 
rent Playltem changes. Accordingly, "Procedure when 
playback condition is changed" is performed for each 
Playltem so as to set PSR1 to a value optimal for the 
Playltem. 

[0131] FIG. 15B is a flowchart of "Procedure when 
playback condition is changed" for PSR1 . This procedure 
sets PSR1 through a combination of two judgment steps 
S1 and S2. 

[0132] First, a judgment is made as to whether the 
number of entries in the STN_table is 0 (SI ). If the number 
of entries in the STN_table is 0, the value of PSR1 is 

maintained (S3). 

[0133] When the number of entries in the STN_table 
is not 0, a judgment is made as to whether the number 
of entries in the STN_table is no smaller than PSR1 and 
also condition (A) is true (S2). Condition (A) is that the 
playback apparatus has a capability of playing an audio 
stream specified by PSR1 . If the judgment in step S2 is 
YES, the value of PSR1 is maintained (S4). If PSR1 is 
greater than the number of entries in the STN_table or 
Condition (A) is false, PSR1 is set to a new value (S5) . 
[0134] FIG. 16 is a flowchart of a detailed procedure 
of step S5. 

[0135] Steps S6 and S7 form a loop in which step S8 
is performed for each audio stream listed in the 
STN_table. In this loop, an audio stream subj ected to 



processing is called audio stream i. A judgment is made 
as to whether audio stream i satisfies three conditions 
(a), (b), and (c) (SB). 

[01 36] Condition (a) is that the playback apparatus has 

5 a capability of playing audio stream i. This judgment is 
made by comparing PSR15 and a stream_coding_type 
of audio stream i shown in the STN_table. 
[0137] Condition (b) is that a language attribute of au- 
dio stream i is same as the language setting of the play- 

10 back apparatus. This judgment is made by checking 
whether an audio_language_code of audio stream i 
shown in the STN_table matches PSR16. 
[01 38] Condition (c) is that a channel attribute of audio 
stream i is surround and the playback apparatus has a 

^5 surround output capability. This judgment is made by 
comparing PSR15 with an audio_presentation_type and 
the stream_coding_type of audio stream i shown in the 
STN_table. 

[0139] The following explains a case where condition 
20 (c) is satisfied, with reference to FIG. 17. FIG. 17 shows 
combinations of capabilities of the playback apparatus 
and stream attributes in a tabular form. The capabilities 
of the playback apparatus include stereo output and sur- 
round output. The stream attributes include stereo and 
25 surround. 

[01 40] When the playback apparatus has a stereo out- 
put capability and the attribute of audio stream i is stereo, 
audio stream i can be played back. 
[0141] When the playback apparatus has a surround 
30 output capability and the attribute of audio stream i is 
stereo, audio stream i can be played back. 
[0142] When the playback apparatus has a surround 
output capability and the attribute of audio stream i is 
surround, audio stream i can be played back. 
35 [01 43] When the playback apparatus has a stereo out- 
put capability and the attribute of audio stream i is sur- 
round, audio stream i can still be played back if the play- 
back apparatus downmixes AC-3 (5.1 ch) to AC-3 (2ch) . 
Thus, audio stream i can be play back with any of the 
^0 four combinations of the capabilities of the playback ap- 
paratus and the channel attributes of audio stream i. How- 
ever, condition (c) is defined to be true only with one of 
the four conditions, namely, the playback apparatus has 
a surround output capability and the channel attribute of 
45 audio stream i is surround. Thus, a strict condition is given 
as condition (c). 

[0144] Though condition (c) is defined to be true only 
with the above combination, this is merely one example, 
and condition (c) may be defined to be true also with the 
50 combination in which the playback apparatus has a ster- 
eo output capability and the channel attribute of audio 
stream i is stereo. In this case, if the playback apparatus 
is only capable of stereo output or has been set to prior- 
itize stereo output over surround output, stereo playback 
55 of a 2ch audio stream is selected over down mixed play- 
back of a 5.1ch audio stream. 

[0145] Based on a pattern of conditions audio stream 
i satisfies, that is, which conditions and how many con- 
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ditions audio stream i satisfies among the three condi- 
tions, a priority is given to audio stream i. 
[0146] After the loop is performed for each audio 
stream, steps S9 to SI 3 are performed. A judgment is 
made as to whether no audio stream satisfies condition 
(a) (S9). If there is no audio stream which satisfies con- 
dition (a), PSR1 is set to the undefined value (OxFF) 
(S14). 

[01 47] A judgment is made as to whether there is any 
audio stream that satisfies all conditions (a), (b), and (c) 
(SI 0). If there is such an audio stream, PSR1 is set to a 
stream number of that audio stream (SI 5). 
[0148] Here, if there are two or more audio streams 
that satisfy conditions (a), (b), and (c), these audio 
streams are equal in priority. In such a case, one of the 
audio streams is selected according to the order of entries 
in the STN_table (S15) . Which is to say, if there are two 
or more audio streams that have a same combination of 
codec, language attribute, and channel attribute, one of 
the audio streams which has a highest entry in the 
STN_table is selected as a highest-priority audio stream. 
[0149] Suppose there are three audio streams that 
have a same combination of codec, language attribute, 
and channel attribute and respectively correspond to 
main program sound, commentary sound, and BGM. In 
this case, an entry of the audio stream corresponding to 
the main program sound is placed first in the STN_table, 
which is followed by an entry of the audio stream corre- 
sponding to the commentary sound and an entry of the 
audio stream corresponding to the BGM, as shown in 
FIG. 18. As a result, the main program sound is selected 
automatically over the commentary sound and the BGM. 
[0150] Thus, by adjusting the order of audio stream 
entries in the STN_table, the author can exercise audio 
stream selection control, i.e. the author can specify which 
audio stream is selected for playback. 
[01 51 ] When there is no audio stream that satisfies all 
conditions (a) , (b) , and (c) , a judgment is made as to 
whether there is any audio stream that satisfies condi- 
tions (a) and (b) (S1 1). If there is any audio stream that 
satisfies conditions (a) and (b), PSR1 is set to a stream 
number of an audio stream having a highest entry in the 
STN_table among the audio streams satisfying condi- 
tions (a) and (b) (SI 6). 

[0152] When there is no audio stream that satisfies all 
conditions (a), (b), and (c) and no audio stream that sat- 
isfies conditions (a) and (b) , a judgment is made as to 
whether there is any audio stream that satisfies condi- 
tions (a) and (c) (S12) . If there is any audio stream that 
satisfies conditions (a) and (c) , PSR1 is set to a stream 
number of an audio stream having a highest entry in the 
STN_table among the audio streams satisfying condi- 
tions (a) and (c) (SI 7). 

[01 53] When there is no audio stream that satisfies all 
conditions (a), (b), and (c), no audio stream that satisfies 
conditions (a) and (b), and no audio stream that satisfies 
conditions (a) and (c) , a judgment is made as to whether 
there is any audio stream that satisfies condition (a) 



(SI 3). If there is any audio stream that satisfies condition 
(a), PSR1 is set to a stream number of an audio stream 
having a highest entry in the STN_table among the audio 
streams satisfying condition (a) (SI 8). 

5 [0154] This completes "Procedure when playback 
condition is changed". The following describes "Proce- 
dure when change is requested". FIG. 19 is a flowchart 
of "Procedure when change is requested" for PSR1 . The 
difference between this flowchart and the flowchart of 

^0 FIG. 15B lies in that X is subjected to judgment instead 
of PSR1 . The value X is based on user operation infor- 
mation output from the operation reception unit 29 or a 
button command output from the Interactive Graphics 
Decoder 13. 

15 [0155] A judgment is made as to whether the number 
of entries in the STN table is no smaller than X and also 
condition (A) is true (S19). Condition (A) is that the play- 
back apparatus is capable of playing an audio stream 
specified by X. This judgment is made by comparing 

20 PSR15 and a stream_coding_type of the audio stream 
shown in the STN_table. If the judgment in step SI 9 is 
YES, PSR1 issettoX (S21). 

[0156] If X is greater than the number of entries in the 
STN_table or condition (A) is false, a judgment is made 

25 as to whether X is OxFF (S22). If X is not OxFF, it means 
the audio stream number requested by the user is invalid, 
so that the value of PSR1 is maintained with the user-des- 
ignated value X being ignored (S23). 
[0157] If PSR1 is OxFF, PSR1 is set to a new value 

30 (S24). A procedure of step 24 is similar to the procedure 
of step S5 shown in FIG. 1 6, except for the following. The 
judgment of step S9 is not needed in "Procedure when 
change is requested", because "Procedure when change 
is requested" maintains the value of PSR1 without setting 

35 PSR1 to the user-designated value X if there is no audio 
stream that satisfies any of conditions (a), (b), and (c). 
[0158] According to the above "Procedure when play- 
back condition is changed" and "Procedure when change 
is requested", an audio stream that is playable by the 
playback apparatus and that makes full use of both the 
features of the BD-ROM and the playback apparatus can 
be selected. 

<Specific Examples of PSR1 Setting> 

45 

[01 59] The procedures shown in the above flowcharts 

are explained using specific examples below. 
[0160] In one specific example, the playback appara- 
tus is a middle-level playback apparatus. The middle-lev- 
50 el playback apparatus referred to here does not have a 
DTS decoding capability but has an LPCM decoding ca- 
pability and an AC-3 surround output capability. Also, the 
language setting of the playback apparatus is Japanese. 
[0161] Suppose the BD-ROM on which an STN_table 
55 shown in FIG. 20B is recorded is loaded to this playback 
apparatus. This STN_table lists entries of six audio 
streams. 

[0162] This being the case, for each audio stream, a 
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judgment is made as to whether conditions (a) , (b) , and 
(c) are satisfied in step S8 in FIG. 1 6. For example, audio 
stream 1 which is listed first in the STN_table satisfies 
only condition (a). Audio stream2 which is listed second 
in the STN_table satisfies conditions (a) and (c). 
[01 63] The judgment on all audio streams reveals that 
audio stream 5 satisfies all conditions (a), (b), and (c), 
audio stream 4 satisfies conditions (a) and (b), audio 
stream 2 satisfies conditions (a) and (c) , and audio 
stream 1 satisfies condition (a). The other audio streams 
are excluded from selection since they do not satisfy con- 
dition (a). 

[0164] Based on this result, a highest priority is given 
to audio stream 5 that satisfies all conditions (a), (b), and 
(c), as shown in FIG. 20C. Hence audio stream 5 is se- 
lected and played together with a video stream. 
[0165] In the above example, the audio stream that 
satisfies all conditions (a), (b), and (c) is selected. The 
following considers a case where the playback apparatus 
does not have a surround output capability. Suppose the 
playback apparatus does not have a surround output ca- 
pability, and an AC-3 (2ch) audio stream and an AC-3 
(5.1 ch) audio stream are multiplexed in an AV Clip on 
the BD-ROM. According to FIG. 17, both of the audio 
streams are playable. Therefore, when these audio 
streams undergo the judgment in the procedure shown 
in FIG. 16, the audio streams will end up being equal in 
priority. 

[0166] In such a case, the STN_table is referenced to 
select one of the audio streams. Even if the playback 
apparatus is incapable of surround output, the playback 
apparatus can still play back the AC-3 (5.1ch) audio 
stream by downmixing it to AC-3 (3ch). Such downmix- 
ing, however, may result in a lower audio quality at the 
time of playback than the one intended by the author. On 
the other hand, the AC-3 (2ch) audio stream is originally 
intended for stereo output. In view of this, the author may 
prefer AC-3 (2ch) playback to downmixed AC-3 (5.1 ch) 
playback. 

[0167] In this case, the author places an entry of the 
AC-3 (2ch) audio stream above an entry of the AC-3 
(5.1 ch) audio stream in the STN_table. 
[0168] As a result, the playback apparatus without a 
surround output capability plays not downmixed AC-3 
(5.1ch) audio but AC-3 (2ch) audio. With regard to a bit 
rate, on the other hand, the AC-3 (5.1ch) audio stream 
has a bit rate of 384 Kbps whereas the AC-3 (2ch) audio 
stream has a bit rate of 1 92 Kbps. Thus, the AC-3 (5.1 ch) 
audio stream has a higher bit rate than the AC-3 (2ch) 
audio stream. The author may consider this more impor- 
tant than the audio quality, and prefer downmixed AC-3 
(5.1 ch) playback to AC-3 (2ch) playback. In this case, 
the author places the entry of the AC-3 (5.1 ch) audio 
stream above the entry of the AC-3 (2ch) audio stream 
in the STN_table. 

[0169] As a result, the playback apparatus without a 
surround output capability plays not AC-3 (2ch) audio but 
downmixed AC-3 (5.1ch) audio. 



[0170] The following gives an example of STN_table 
description and audio stream selection when the author 
prefers AC-3 (2ch) playback to downmixed AC-3 (5.1 ch) 
playback, by referring to FIG. 21 . 

5 [0171] In this example, the playback apparatus does 
not have a surround output capability, so that PSR15and 
PSR16 are set as shown in FIG. 21 A. Meanwhile, the 
STN_table has the same contents as the one in FIG. 
20B, as shown in FIG. 21 B. In such a case, audio stream 

^0 4 and audio stream 5 that satisfy conditions (a) and (b) 
have the same priority "1 ", and audio stream 1 and audio 
stream 2 that satisfy condition (a) have the same priority 
"2". Since audio streams 4 and 5 are equal in priority, the 
playback apparatus selects one of audio streams 4 and 

f5 5 based on the order of entries in the STN_table. Since 
the author prefers AC-3 (2ch) playback to downmixed 
AC-3 (5. 1 ch) playback, the entry of the AC-3 (2ch) audio 
stream is higher than the entry of the AC-3 (5.1 ch) audio 
stream in the STN_table shown in FIG. 21 B. In other 

20 words, audio stream 4 has a higher entry than audio 
stream 5 in the STN_table. Therefore, the playback ap- 
paratus selects audio stream 4 and plays audio stream 4. 
[0172] The following explains an example of 
STN_table description and audio stream selection when 

25 the author prefers downmixed AC-3 (5.1 ch) playback to 
AC-3 (2ch) playback, by referring to FIG. 22. 
[0173] Since the author prefers downmixed AC-3 
(5.1ch) playback, the AC-3 (5.1ch) audio streams (audio 
streams 2 and 5) respectively have higher entries than 

30 the AC-3 (2ch) audio streams (audio streams 1 and 4) in 
the STN_table shown in FIG. 22B. Which is to say, audio 
stream 5 is placed above audio stream 4 in the 
STN_table. Accordingly, when audio streams 4 and 5 
satisfy the same conditions (a) and (b) , the playback 

35 apparatus selects audio stream 5 and plays audio stream 
5, as shown in FIG. 22C. 

[0174] Thus, the author can determine which of AC-3 
(2ch) playback and downmixed AC-3 (5.1 ch) playback 

is performed when the playback apparatus does not have 
"^0 a surround output capability. This makes it possible to 
realize playback control that reflects the preference of 
the author. This concludes the description of the status 
control regarding PSR1 . 



[0175] The following describes PSR2. PSR2 is used 
to specify which of a plurality of PG streams and textST 
streams listed as entries in the STN_table of the current 
Playltem is to be played. When PSR2 is changed, the 
playback apparatus plays back a PG stream or a textST 
stream specified by the changed PSR2. PSR2 is initially 
set to an undefined value, and can be set to one of the 
values 1 to 255 by the playback apparatus. The undefined 
value is OxFFFF, indicating that no PG stream or textST 
stream is present or no PG stream or textST stream is 
selected. The values 1 to 255 are interpreted as 
PG textST stream numbers. FIG. 23A shows status 
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transitions that can be made by PSR2. The status tran- 
sitions shown in FIG. 23A are same as those shown in 
FIG. 15A. FIG. 23B is a flowchart of "Procedure when 
playback condition is changed" for PSR2, and FIG. 24 is 
a flowchart of "Procedure when change is requested" for 
PSR2. These flowcharts are respectively similar to those 
in FIGS. 15B and 19, but substantially differ in a PSR2 
setting procedure in steps S5 and S23. 
[0176] FIG. 25 is a flowchart of the PSR2 setting pro- 
cedure. 

[0177] In the drawing, steps S31 and S32 form a loop 
in which steps S33 to S35 are performed for each 
PG_textST_stream listed in the STN_table. In this loop, 
the PG_textST_stream subjected to processing is called 
PG_textST_stream i. A judgment is made as to whether 
a stream_coding_type of PG_textST_stream i shown in 
the STN_table is 0x90 or 0x92 (S33). If the 
stream_coding_type is 0x90, the procedure advances to 
step S34. 

[0178] A judgment Is made as to whether 
PG_textST_stream i satisfies the following conditions (a) 
and (b) (S34). 

[0179] Condition (a) is that the playback apparatus is 
capable of playing PG stream i. 

[0180] Condition (b) is that a language attribute of PG 
stream i matches the language setting of the playback 

apparatus. 

[0181] The judgment for condition (b) is made by 
checking whether a PG_language_code of PG stream i 
shown in the STN_table matches PSR17. 
[0182] If the stream_coding_type is 0x92, a judgment 
is made as to whether PG_textST_stream i satisfies the 
following conditions (a) and (b) (S35). 
[0183] Condition (a) is that the playback apparatus is 
capable of playing textST stream i. 
[0184] Condition (b) is that a language attribute of 
textST stream i matches the language setting of the play- 
back apparatus. 

[0185] The judgment for condition (a) is made by 
checking whether PSR30 shows "capable". The judg- 
ment for condition (b) is made by checking whether a 
textST_language_code of textST stream i shown in the 
STN_table matches PSR17. 

[0186] After steps 833 to 835 are performed for all 
PG_textST_st reams, the procedure advances to steps 
S36 toS41. 

[0187] A judgment is made as to whether there is no 
PG_text8T_stream that satisfies condition (a) (836). If 
there is no PG_textST_stream that satisfies condition (a), 
PSR2 is set to an invalid value (OxFFFF) (838). 
[0188] A judgment is made as to whether there is any 
PG_text8T_stream that satisfies conditions (a) and (b) 
(837). If there is such a PG_textST_stream, P8R2 is set 
to a stream number of a PG_textST_stream having a 

highest entry in the 8TN stable among 

PG ^textST_streams satisfying conditions (a) and (b) 

(839). 

[0189] If the judgment in step 837 is NO, P8R2 is set 



to a stream number of a stream having a highest entry 
in the 8TN_table among PG streams satisfying condition 
(a) and textST_streams satisfying condition (a) (841). 
The procedure of this flowchart is explained in more detail 
5 below, using specific examples. 

<Specific Examples of PSR2 8etting> 

[0190] In one specific example, the playback appara- 
10 tus is capable of decoding a PG stream but incapable of 
decoding a text8T stream, as shown in FIG. 26A. Also, 
the language setting of the playback apparatus is Japa- 
nese. 

[0191] Suppose the BD-ROM on which an 8TN_table 

15 shown in FIG. 26B is recorded is loaded to this playback 
apparatus. The 8TN_table has entries of two textST 
streams (PG_text8T_streams 1 and 3) and two PG 
streams (PG_text8T_streams 2 and 4). 
[0192] This being the case, steps 834 and 835 are 

20 performed to judge, for each PG_textST_stream, wheth- 
er conditions (a) and (b) are satisfied, as shown in FIG. 
26C. Here, PG_textST_st reams 1 and 3 do not satisfy 
condition (a), PG_text8T_stream 2 satisfies only condi- 
tion (a), and PG_textST_stream 4 satisfies both condi- 

25 tions (a) and (b). 

[0193] The judgment on all PG_text8T_streams in the 
8TN_table reveals that PG_text8T_stream 4 satisfies 
conditions (a) and (b) and PG_text8T_stream 2 satisfies 
condition (a). PG_textST_streams 1 and 3 do not satisfy 

30 condition (a) and so are excluded from selection. 

[0194] As a result, PG_textST_stream 4 is given a 
highest priority. 

[0195] If there are two or more PG_textST_streams 
that satisfy same conditions, on the other hand, these 

35 PG_text8T_streams are equal in priority. In such a case, 
one of the PG_text8T_streams is selected based on the 
order of entries in the STN_table. 
[0196] A specific example of PG_textST_stream se- 
lection according to the order of entries in the 8TN_table 

'^o is given below, by referring to FIG. 27. In this specific 
example, the playback apparatus is capable of decoding 
both a PG stream and a textST stream. When there are 
a PG stream and a textST stream that have a language 
attribute which matches the language setting of the play- 

45 back apparatus, the PG stream and the textST stream 
are equal in priority. In this case, the author places an 
entry of a preferred stream above an entry of the other 
stream in the 8TN_table. If the author prefers the textST 
stream to the PG stream, the author places an entry of 

50 the textST stream above an entry of the PG stream in 
the STN_table. As a result, the textST stream is selected 
automatically over the PG stream. 
[0197] Thus, by adjusting the order of entries in the 
STN_table, the author can exercise selection control of 

55 which stream is to be selected at the time of playback. 
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<Modifications> 

[01 98] The first embodiment describes tine case wliere 
if X is invalid in "Procedure when change is requested", 
the transition control unit 30 maintains the value of PSR1 5 
or PSR2. This process is not desirable, however, in the 
case where the user presses the audio switch key or the 
subtitle switch Wey. When the audio switch key or the 
subtitle switch key is pressed, X should be PSR + 1. If, 
despite this, the value of PSR1 or PSR2 is maintained io 
on the ground that X is invalid, the user may think that 
the playback apparatus malfunctions. 
[0199] In view of this, when the audio switch key or the 
subtitle switch key is pressed, the transition control unit 
30 performs the following process in addition to "Proce- ^5 
dure when change is requested". In this process, when 
executing "Procedure when change is requested", the 
value of the PSR before "Procedure when change is re- 
quested" is compared with the value of the PSR after 
"Procedure when change is requested". If the two values 20 
are equal, X is incremented by 1 , and "Procedure when 
change is requested" is performed again. X is increment- 
ed until the value of the PSR is updated by "Procedure 
when change is requested". 

[0200] Once the value of the PSR has been updated 25 

by "Procedure when change is requested", the compar- 
ison of the two values results in a mismatch. The value 
of the PSR obtained by "Procedure when change is re- 
quested" at this point is used for stream selection. 
[0201] This process is explainedbrieflybelow, using a 30 
specific example where PSR1 is set to 3 and stream num- 
bers 4 and 5 are invalid. The transition control unit 30 
adds 1 to PSR1 , and sets 4 as X. The transition control 
unit 30 then performs "Procedure when change is re- 
quested". Since the stream number 4 is invalid, PSR1 35 
remains 3. When PSR1 is unchanged like this, the tran- 
sition control unit 30 increments X by 1 , to thereby set X 
to 5. Having done so, the transition control unit 30 per- 
forms "Procedure when change is requested" again. 
Since the stream number 5 is invalid, PSR1 remains 3. "^o 
When PSR1 is unchanged like this, the transition control 
unit 30 increments X by 1 , to thereby set X to 6. Having 
done so, the transition control unit 30 performs "Proce- 
dure when change is requested" again. Since the stream 
number 6 is valid, the stream number 6 is automatically ^5 
selected as a result of "Procedure when change is re- 
quested". By performing the above process when the 
audio switch key is pressed, smooth audio switching can 
be achieved without making the user notice the existence 
of an invalid stream number. 50 

Second Embodiment 

[0202] A second embodiment of the present invention 
relates to status settings for multi-angle blocks. A data 55 
structure for realizing a multi-angle block can be provided 
in the Playltem information shown in FIG. 5. FIG. 28 
shows a data structure of Playltem information corre- 



sponding to a multi-angle block. In the drawing, the Play- 
ltem information is made up of a basic part that is com- 
patible with Playltem information corresponding to a 
non-multi-angle block, and an extension part for realizing 
the multi-angle block. The basic part has a same data 
structure as the one shown in FIG. 5, and includes a 
Clip_lnformation_file_name field, a Clip_codecJdenti- 
fier field, an IN_time field, an OUT_time field, and an 
STN_table field. In the multi-angle block, an AV Clip spec- 
ified by this basic part is treated as a first angle block. In 
this way, even if a playback apparatus that does not sup- 
port multi-angle (a playback apparatus that corresponds 
only to a BD-RE data structure) reads Playltem informa- 
tion corresponding to a multi-angle block, the playback 
apparatus can play the first angle block by referencing 
the basic part. Meanwhile, the extension part is made up 
of an is_multi_angles field, a number_of_angles field, 
and Angle information [2], ... , [j]. 

[0203] The is_multi_angles field shows whether a 
playback section corresponding to the Playltem informa- 
tion is a multi-angle blocker a non-multi-angle block. 
[0204] The number_of_angles field shows, when the 
is_multi_angles field shows a multi-angle block, the 
number of angles in the multi-angle block. 
[0205] The Angle information [2], ... , [j] is information 
for each individual angle block in the multi-angle block, 
and includes a Clip_lnformation_file_name field and a 
Clip_codec_identifier field. 

[0206] The Clip_lnformation_file_name field shows a 
filename of an AV Clip that forms the angle block. 
[0207] The Clip_codec_identifier field shows a coding 
method of the AV Clip specified by the filename shown 
by the Clip_lnformation_file_name field in the Angle in- 
formation. 

[0208] As shown in the drawing, the Angle information 
does not have an IN_time field and an OUT_time field. 
This is because a beginning and end of each angle block 
except the first angle block are specified by the IN_time 
field and the OUT_time field in the basic part. In other 
words, a playback time of the AV Clip specified by the 
Clip Information file name field in the Angle information 
needs to be same as a playback time of the AV Clip spec- 
ified by the Clip_lnformation_file_name field in the basic 
part. Also, time stamps (System Time Clock) which spec- 
ify presentation timings on the AV Clip playback time axis 
need to be equal for the two AV Clips. 
[0209] A specific example of a Playltem corresponding 
to a multi-angle block is given below. In this specific ex- 
ample, three Playltems (Playltems #1, #2, and #3) are 
used. Of these Playltems, Playltems #1 and #3 constitute 
multi-angle blocks, whereas Playltem #2 constitutes a 
non-multi-angle block. Also, a plurality of AV Clips shown 
in FIG. 29 (FRONT1, RIGHT1, LEFT1, FRONT2, 
FRONT3, and RIGHT 2) are recorded on the BD-ROM. 
Clip_lnformation_file_names of Playltem #1 specify 
FRONT1 , LEFT1 , and RIGHT1 , a CIip_lnformation_file_ 
name of Playltem #2 specifies FRONT2, and Clip_ 
lnformation_file_names of Playltem#3specify FRONT3 
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and RIGHT2. These Playltemsdefine a main path that is 
made up of a multi-angle block, a non-multi-angle block, 
and a multi-angle block in this order. FIGS. 30A and SOB 
show the multi-angle blocks and non-multi-angle block 
defined in this way. In the drawing, arrows my1 and my2 
indicate designation by two sets of Angle information in 
Playltem #1 , and arrow my3 indicates designation by one 
set of Angle information in Playltem #3. According to the 
designation my1 and my2 by the two sets of Angle infor- 
mation in Playltem #1, one of RIGHT1 and LEFT1 can 
be selected for playback instead of part of the AV Clip. 
Likewise, according to the designation my3 by the set of 
Angle information in Playltem #3, RIGHT2 can be select- 
ed for playback instead of part of the AV Clip. 
[0210] FIG. SOB shows a progress of playback of the 
multi-angle blocks andnon-multi-angle block. As indicat- 
ed by arrows ag1 , ag2, and agS, one of the three angle 
blocks can be selected in multi-angle block 1. Also, as 
indicated by arrows ag4 and ag5, one of the two angle 
blocks can be selected in multi-angle block 3. This con- 
cludes the description of the improvements in the record- 
ing medium of the second embodiment. 
[0211] The following describes improvements in the 
playback apparatus of the second embodiment. In the 
playback apparatus, PSR3 specifies an angle block. In 
the second embodiment, the control unit 24 controls an- 
gle block selection and playback according to PSRS. 
[0212] In detail, the control unit 24 references PSRS, 
upon playback of the current Playltem in the current Play- 
List. If PSRS = 1 , the control unit 24 controls the BD-ROM 
drive 1 to access an AV Clip specified by a Clip_ 
lnformation_file_name in the basic part of the current 
Playltem and read TS packets of the AV Clip from an 
IN_time to an OUT_time in the current Playltem. The 
read TS packets are fed to the Video Decoder 4 to play 
an angle block. 

[021 3] If PSRS is 2 or more, the control unit 24 controls 
the BD-ROM drive 1 to access an AV Clip (aforemen- 
tioned RIGHT1, LEFT1, or RIGHT2) specified by a 
Clip_lnformation_file_name in Angle Information in the 
extension part of the current Playltem, and read TS pack- 
ets of the AV Clip. The read TS packets are fed to the 
Video Decoder 4 to play an angle block. Thus, by ac- 
cessing a different AV Clip depending on the value of 
PSRS, selective playback of angle blocks can be 
achieved. 

[0214] PSRS which specifies an angle block is ex- 
plained below. FIG. 31 shows settings of PSRS. PSRS 
specifies a number of an angle block that is currently 
selected. PSRS takes one of the values 1 to 9, to specify 
one of angle blocks 1 to 9. 

[021 5] Status transitions of PSRS are explained below. 
FIG. S2A shows status transitions that can be made by 
PSRS. When comparing this drawing with FIG. 15A, it 
can be understood that there is no status transition trig- 
gered by "Cross a Playltem boundary". Also, "Start Play- 
List playback" and "Terminate PlayList playback" have 
been replaced respectively with "Start Playltem with multi 



angle structure" and "End of a Playltem with multi angle 
structure". Further, "Procedure when change is request- 
ed" has been changed from "stream change is request- 
ed" to "angle change is requested". Apart from these dif- 
5 ferences, the status transitions of PSSRS are same as 
those shown in FIG. 15A. 

[0216] The number of audio streams differs for each 
Playltem. Accordingly, when playbackof a PlayList starts 
and each time the playback crosses a Playltem bound- 

^0 ary, "Procedure when playback condition is changed" 
needs to be performed to set PSR1 . On the other hand, 
PSRS is used only in a multi-angle block, and so there 
is no need to perform "Procedure when playback condi- 
tion is changed" each time a Playltem boundary is 

^5 crossed. Therefore, a status transition from Invalid to Val- 
id is triggered by a start of playback of a multi-angle block, 
and a status transition from Valid to Invalid is triggered 
by an end of playback of a multi-angle block. 
[0217] In this embodiment, the value of PSRS is main- 

20 tained upon the status transition from Valid to Invalid. 
Which is to say, when a multi-angle block and a non-mul- 
ti-angle block appear alternately (e.g. FIG. SO), only the 
state of PSRS is changed from Valid to Invalid and vice 
versa, without changing the value of PSRS. This con- 

25 eludes the description of the status transitions of PSRS. 
The following describes "Procedure when playback con- 
dition is changed" and "Procedure when change is re- 
quested" for PSRS. 

[0218] FIG. S2B is a flowchart of "Procedure when 
30 playback condition is changed" for PSRS. This flowchart 
has a similar algorithm to the one shown in FIG. 15B. A 
judgment is made as to whether the number of angles in 
the current Playltem is no smaller than PSRS (S51). If 
the number of angles in the current Playltem is no smaller 
35 than PSRS, the value of PSRS is maintained (S5S). Oth- 
erwise, PSRS is set to an initial value "1" (S52). 
[0219] FIG. S2C is a flowchart of "Procedure when 
change is requested" for PSRS. This flowchart has a sim- 
ilar algorithm to the one shown in FIG. 1 9. A judgment is 
"^0 made as to whether the number of angles in the current 
Playltem is no smaller than X (S54). If the number of 
angles in the current Playltem is no smaller than X, PSRS 
is set to X (S57). Otherwise, the value of PSRS is main- 
tained (S55). 

45 [0220] Angle block selection performed when playing 
the multi-angle block, the non-multi-angle block, and the 
multi-angle block in this order according to the three Play- 
Items shown in FIG. SO is explained below, by referring 
to FIG. SS. 

50 [0221] In FIG. SSA, PSRS is set to 2. This being so, 
when playbackof Playltem #1 starts, the control unit 24 
selects an angle block (RIGHT1) specified by PSRS = 2 
and plays the selected angle block. Once the playback 
of RIGHT1 ends, PSRS is changed to Invalid while being 

55 held at 2. 

[0222] Multi-angleblock#1 specifiedbyPlayltem#1 is 
followed by non-multi-angle block #2 specified by Play- 
ltem #2. Since this is a non-multi-angle block, PSRS're- 
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mains Invalid. Which is to say, PSR3 is treated as Invalid 
while being held at 2. Since PSR3 is Invalid, the control 
unit 24 plays part of the AV Clip (XXX.M2TS) from an 
IN_tlme to an OUT_time of Play Item #2, irrespective of 
the value of PSR3. 

[0223] Non-multi-angle block #2 is followed by mul- 
ti-angle block #3 specified by Playltem #3. When play- 
back of multi-angle block #3 begins, PSR3 is changed 
from Invalid to Valid while being held at 2. Since PSR3 
becomes Valid, an angle block specified by PSR3 is se- 
lected. Here, PSR3 = 2, so that the control unit 24 selects 
an angle block (RIGHT2) specified by PSR3 = 2 and plays 
the selected angle block. Arrow gg1 in FIG. 33A indicates 
a course of angle block selection described above. 
[0224] The above concerns the case where PSR3 is 
set to 2. The following explains the case where PSR3 is 
set to 3. In FIG. 33B, playback of multi-angle block #1 is 
performed as in FIG. 33A. After this, PSR3 is changed 
to Invalid while being held at 3 as a result of the status 
transition shown in FIG. 32A, and playback of non-mul- 
ti-angle block #2 is performed in this state. After the play- 
back of non-multi-angle block #2, playback of multi-angle 
block #3 starts. Since this is the "Start Playltem with multi 
angle structure" event, "Procedure when playback con- 
dition is changed" is performed. In step S51 in FIG. 32B, 
a judgment is made as to whether PSR3 exceeds the 
number of angles in Playltem #3. Since the number of 
angles in Playltem #3 is 2, PSR3 = 3 exceeds the number 
of angles. Accordingly, PSR3 is set to 1 (S52) . As a 
result, the AV Clip XXX.M2TS corresponding to the first 
angle block in Playltem #3 is selected and played back, 
as shown in FIG. 33B. Arrow gg2 in FIG. 338 indicates 
a course of angle block selection in this case. 
[0225] According to the second embodiment, PSR3 
makes such status transitions that avoid selecting a non- 
existent angle block. Accordingly, even when switching 
from a multi-angle block to a non-multi-angle block and 
vice versa occur frequently, a wrong number will not be 
set in PSR3. This ensures the accuracy in angle selec- 
tion, with it being possible to facilitate distribution of movie 
films that incorporate multi-angle. 

Third Embodiment 

[0226] A third embodiment of the present invention re- 
lates to status settings when executing an interactive 
function. The interactive function referred to here pro- 
vides a plurality of Pages, places graphics Button mem- 
bers on each Page, and receives a user operation. When 
executing the interactive function, this embodiment per- 
forms status settings about which Page is to be displayed 
and which Button on that Page is to be focused. 

<Data Structure for the Interactive Function> 

[0227] Adatastructure for displaying a plurality of Pag- 
es and Buttons can be provided in the IG stream de- 
scribed in the first embodiment. The IG stream is ex- 



plained below, with reference to FIG. 34. The IG stream 
includes an ICS, a PDS, and an ODS. The ODS is graph- 
ics data for displaying a Button graphically. The PDS is 
pallet data for specifying a color of the Button. 
5 [0228] The ICS is control information for displaying a 
Page synchronously with a moving picture. The synchro- 
nization with the moving picture is designated by a DTS 
and a PTS in a PES packet carrying the ICS. That is, the 
DTS in the PES packet carrying the ICS shows a begin- 
10 ning of a period during which the interactive function is 
valid (a period during which the ICS is Valid). 
[0229] Arrow cu1 in FIG. 34 indicates a structure of the 
ICS in detail. As illustrated, the ICS includes a 
loading_model field, a user_interface_model field, a 
compos ition_time_outjDts field, a selection_time_out_ 
pts field, a use r time out du ration field, and page infor- 
mation (1), (2), ... , (i), ... , (n) which each correspond to 
a different one of a plurality of Pages available for pres- 
entation. 

[0230] The loading_model field shows whether the IG 
stream is multiplexed in the AV Clip or is preloaded in 
the playback apparatus separately from the AV Clip. 
[0231 ] The user_interface_model field shows whether 
a Page is constantly displayed (Always-on) or popped 
up based on a user operation (Pop-up) , during the play- 
back of the moving picture. 

[0232] The composition_time_out_pts field shows an 
end of the period during which the interactive function is 
valid. 

[0233] The user_time_out_duration field shows a pe- 
riod of time after which Page display is to time-out if there 
is no user operation. 

[0234] The page information is explained below. Arrow 

cu2 in FIG. 34 indicates a structure of the page informa- 
tion in detail. As illustrated, the page information includes 
a page_id field, a UO_mask_table field, an in_effects 
field, an out_effects field, an animation_frame_ 
rate_code field, a default_selected_button_id_ref field, a 
default_activated_button_id_ref field, a pallet_id_ref 
field, and buttonjnfo (1), (2), ... , (i), ... ,(n) each corre- 
sponding to a different one of a plurality of Buttons. 
[0235] The pagejd field shows an identifier uniquely 
identifying a Page corresponding to the page information. 
[0236] The UO_mask_table field shows permissions/ 
prohibitions of user operations in a Display Set (DS) to 
which the ICS belongs. If this mask field is set to "Pro- 
hibited" for a user operation, that user operation to the 
playback apparatus is invalid. 

[0237] The in_effects field shows a display effect to be 
presented immediately before the Page is displayed. 
[0238] The out_effects field shows a display effect to 
be presented immediately after the Page is removed from 
display. 

[0239] The animation_frame_rate_code field shows a 
frame rate to be applied to an animated Button. 
[0240] The default_selected_button_id_ref field 
shows whether a Button to be set in a selected state as 
default when the presentation of the Interactive Display 
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(Page) begins is determined dynamically or statically. 
When this field is set to OxFF the Button to be set in the 
selected state as default is determined dynamically. In 
this case, a PSR in the playback apparatus is used pref- 
erentially, so that a Button specified by PSR10 is put in 5 
the selected state. When this field is not set to OxFF, on 
the other hand, the Button to be set in the selected state 
is determined statically. In this case, PSR10 is set to a 
button number shown by the default_selected_button_ 
id ref, and a Button specified by PSR10 Is put in the 
selected state. 

[0241] The default_activated_button_id_ref shows a 

Button to be automatically set in an activated state if the 
user does not activate any Button before a time defined 
by the se lectio n_time_outjDts. When this field is set to 
FF, the Button currently in the selected state is automat- 
ically set in the activated state at the time defined by the 
se lectio n_time_outjDts. When this field is set to 00, no 
Button is auto-activated. When this field is set to a value 
that is neither GO nor FF, the value is interpreted as a 20 
valid button number specifying a Button to be auto-acti- 
vated. 

[0242] The pailet_id_ref field shows an identifier of a 
Palletto be set in a GLUT unit for producing the Interactive 
Display. 25 
[0243] The button_info field defines a Button to be pre- 
sented on the Interactive Display. FIG. 35 shows a struc- 
ture of the buttonjnfo. Guideline hp1 in the drawing 
shows a structure of buttonjnfo i of Button i controlled 
by the ICS, in detail. Each individual Button presented so 
on the Page has three states that are a normal state, a 
selected state, and an activated state. The normal state 
is a state where the Button is simply displayed. The se- 
lected state is a state where the Button is focused ac- 
cording to a user operation but the selection of the Button 35 
is not confirmed yet. The activated state is a state where 
the selection of the Button has been confirmed. Since 
Button i has these three states, buttonjnfo i has the fol- 
lowing fields. 

[0244] A button_number field specifies a number "^o 
uniquely identifying Button i in the ICS. 
[0245] A numerically_selectablejlag field shows a 
flag indicating whether numeric selection is available for 
Button i. 

[0246] An auto_action Jlag field shows whether Button ^5 
i is to be automatically set in the activated state. When 
the auto_actionJlag field is set to ON (bit value "1") , 
Button i is changed not to the selected state but directly 
to the activated state, when Button i becomes selected. 
If the auto_actionJlag field is set to OFF (bit value "0"), 50 
Button i is changed not directly to the activated state but 
to the selected state, when Button i becomes selected. 
[0247] A button_horizontal _position field and a 
button_vertlcal_position field respectively show a hori- 
zontal position and a vertical position of a top left pixel 55 
of Button i in the Interactive Display. 
[0248] An upper_button_number field shows a button 
number of a Button to receive the selected state when a 
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user operation of pressing the Move Up key is made while 
Button i is in the selected state. If this field shows the 
button number of Button i, then a user operation of press- 
ing the Move Up key is ignored. 

[0249] A lower_button_number field, a left_button 

number field, and a right_button_number field respec- 
tively show button numbers of Buttons to receive the se- 
lected state when user operations of pressing the Move 
Down key, the Move Left key, and the Move Right key 
are performed while Button i is in the selected state. If 
any of these fields shows the button number of Button i, 
then a corresponding user operation is ignored. 
[0250] A start_objectJd_normal field specifies a be- 
ginning one of objectjds that are serially assigned to a 
sequence of ODSs used to present the normal state of 
Button i in animation. 

[0251] An end_objectJd_normal field specifies a last 
one of the objectjds that are serially assigned to the 
sequence of ODSs used to present the normal state of 
Button i in animation. If the end_objectJd_normal field 
specifies the same I D as the start_object Jd_normal field, 
a static image of a graphics Object identified by this ID 
is presented as Button i. 

[0252] A repeat_normalJlag field specifies whether 
the animation of Button i in the normal state is to be con- 
tinuously repeated. 

[0253] A start_objectJd_selected field specifies a be- 
ginning one of objectjds that are serially assigned to a 
sequence of ODSs used to present the selected state of 
Button i in animation. 

[0254] An end_objectJd_selected field specifies a last 
one of the objectjds that are serially assigned to the 
sequence of ODSs used to present the selected state of 
Button i in animation. If the end_objectJd_selected field 
specifies the same ID as the start_objectJd_s elected 
field, a static image of a graphics Object identified by this 
ID is presented as Button i. 

[0255] A repeat_selectedjlag field specifies whether 

the animation of Button i in the selected state is to be 
continuously repeated. If the start_objectJd_selected 
field and the end_objectJd_selected field have a same 
value, the repeat_selectedjlag field is set to 00. 
[0256] A start_objectJd_activated field specifies a be- 
ginning one of objectjds that are serially assigned to a 
sequence of ODSs used to present the activated state 
of Button i in animation. 

[0257] An end_objectJd activated field specifies a last 
one of the objectjds that are serially assigned to the 
sequence of ODSs used to present the activate state of 
Button i in animation. 

[0258] The following describes button commands. 
[0259] A button command (button_command) is a 
command that is executed when Button i is activated. 
The following commands (i) to (iv) are used as button 
commands, to write a value to a PSR or a G PR or read 
a value from a PSR or a GPR. 

(i) Get value of Player Status Register command 
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(written as "Get value of Player Status Register (aug- 
ment)") 

This function acquires a value from a PSR specified 
by the augment. 

(11) Set value of Player Status Register command 
(written as "Set value of Player Status Register (aug- 
ment 1 , augment 2)") 

This function sets a value specified by augment 2, 
to a PSR specified by augment 1 . 

(ill) Get valueof General Purpose Registercommand 
(written as "Get value of General Purpose Register 
(augment) ") 

This function acquires a value from a GPR specified 
by the augment. 

(iv) Setvalue of General Purpose Registercommand 
(written as "Set value of General Purpose Register 
(augment 1 , augment 2)") 

This function sets a value specified by augment 2, 
to a GPR specified by augment 1 . 

<Specific Example> 

[0260] This concludes the description of the structure 
of the ICS. A specific example of interactive control by 
the ICS is given below. This specific example uses an 
ICS and ODSs shown in FIG. 36. FIG. 36 shows a rela- 
tionship between the ICS and the ODSs included in DSn. 
The ODSs are made up of ODS1 1 to ODS1 9, ODS21 to 
ODS29, ODS31 to ODS39, and ODS41 to ODS49. 
ODS11 to ODS19 represent each state of Button 1-A, 
ODS21 to ODS29 represent each state of Button 1-B, 
ODS31 to ODS39 represent each state of Button 1-C, 
and ODS41 to ODS49 represent each state of Button 
1-D, as indicated by the parenthesis "}" in the drawing. 
The ICS contains page information (1), (2), and (3) cor- 
responding to three Pages 1 to 3. Status control of But- 
tons 1-A to 1-D is defined in buttonjnfo (1), (2), (3), and 
(4) in page information (1) of Page 1 (as indicated by 
arrows bh1 , bh2, bh3, and bh4 in the drawing). 
[0261] When timing of the control by the ICS matches 
presentation timing of picture data pt1 of a moving picture 
shown in FIG. 37, Page 1 out of the three Pages (Pages 
1 to 3) available for presentation by the ICS is overlaid 
on picture data pt1 and displayed (gs2). Thus, an Inter- 
active Display provided with a plurality of Buttons is pre- 
sented in correspondence with the contents of the mov- 
ing picture. In this way, realistic presentation using But- 
tons can be achieved through the use of an ICS. 
[0262] FIG. 39 shows an example of ICS description 
for defining status transitions of Buttons 1 -A to 1 - D shown 
in FIG. 38. Arrows hhl and hh2 in FIG. 38 represent 
status transitions defined by neighbor_info() in 
buttonjnfo (1 ), which is associated with Button 1 -A. The 
lower button number field In the neighbor_lnfo() in 
buttonjnfo (1 ) is set to specify Button 1 -C. Accordingly, 
when a user operation of pressing the Move Down key 
is made while Button 1-A is in the selected state (upl in 
FIG. 38) , Button 1-C receives the selected state (sjl in 



FIG. 38). The right_button_number field in the neighbor_ 
info() in buttonjnfo (1) is set to specify Button 1-B. Ac- 
cordingly, when a user operation of pressing the Move 
Right key is made while Button 1-A is in the selected 
5 State (up2 in FIG. 38), Button 1-B receives the selected 
state (sj2 in FIG. 38). 

[0263] Arrow hh3 in FIG. 38 indicates control of a status 
transition defined by neighborJnfo() in buttonJnfo(3). 
The upper_button_number field in the neighborJnfoQ in 

10 buttonJnfo(3), which is associated with Button 1-C, is 
set to specify Button 1-A. Accordingly, when a user op- 
eration of pressing the Move Up key is made while Button 
1-C is in the selected state (up3 in FIG. 38), Button 1-A 
is put back to the selected state (sj3 in FIG. 38) . Button 

15 1 -A corresponds to a button command "Set Page 2". This 
command instructs the playback apparatus to switch to 
Page 2. Upon activation of Button 1-A, this command is 
executed, as a result of which Page 1 is switched to Page 
2 as shown in FIG. 40. 

20 

< Playback Apparatus> 

[0264] This concludes the description of the improve- 
ments in the recording medium of the third embodiment. 

25 The following describes the playback apparatus of the 
third embodiment. Of the plurality of PSRs in the playback 
apparatus, PSRO, PSR11, and PSR10 relate to the in- 
teractive function. PSRO, PSR10, and PSR11 are ex- 
plained below, with reference to FIG. 41 . 

30 [0265] PSRO specifies one of a plurality of IG streams 
which are listed as entries in the STN Jable of the current 
Playltem. 

[0266] PSR1 1 specifies, when the IG stream specified 
by PSRO contains a plurality of Pages available for pres- 
35 entation, one of the plurality of Pages. 

[0267] PSR10 specifies, when the Page specified by 
PSR1 1 has a plurality of Buttons, one of the plurality of 
Buttons. 

[0268] To realize the interactive function, PSRO makes 

40 the following status transitions. PSRO is initially set at 1 , 
andean be set to any of the values 2 to 32 by the playback 
apparatus. FIG. 42A shows status transitions that can be 
made by PSRO. FIG. 42B is a flowchart of "Procedure 
when playback condition is changed" for PSRO. FIG. 43 

45 is a flowchart of "Procedure when change is requested" 
for PSRO. These status transitions and flowcharts are 
same as those of PSR1 and PSR2 described in the first 
embodiment. As in the case of audio streams and 
PG textST_streams, when IG streams corresponding to 

50 multiple languages are multiplexed in the AV Clip, one 
of the IG streams that matches the language setting of 
the playback apparatus is selected and played back. 
Here, the playback apparatus selects the IG stream de- 
pending on the order of entries in the STN Jable. There- 

55 fore, by adjusting the order of entries in the STN Jable, 
the author can control which IG stream is to be selected. 
This concludes the description of the status transitions 
of PSRO. 
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[0269] PSR10 and PSR11 make status transitions 
similar to those described in the first and second embod- 
iments, too. This will be described in detail later. 
[0270] The following describes a construction of the 
playback apparatus of the third embodiment. PSROspec- 5 
ifies the IG stream to be played. This being so, the control 
unit 24 and the Demultiplexer 3 perform the following 
processing. 

[0271] The control unit 24 extracts a RID from one of 

the entry-attribute combinations of IG streams in the 
STN_table that is specified by PSRO, and sets the PID 
in the Demultiplexer 3. 

[0272] The Demultiplexer 3 outputs, from among TS 
packets read from the BD-ROM and the HD, TS packets 
having the PID set by the control unit 24, to the Interactive ^5 
Graphics Decoder 13. Hence an ICS, a PDS, and an 
ODS are fed to the Interactive Graphics Decoder 13. 

<lnternal Construction of the Interactive Graphics De- 
coder 13> 20 

[0273] An internal construction of the Interactive 
Graphics Decoder 13 is described below, with reference 
to FIG. 44. As shown in the drawing, the Interactive 
Graphics Decoder 13 includes a Coded Data Buffer 33, 25 
a Stream Graphics Processor 34, an Obj ect Buffer 35, 
a Composition Buffer 36, and a Graphics Controller 37. 
[0274] The Coded Data Buffer 33 is a buffer for tem- 
porarily storing an ICS, a PDS, and an ODS together with 
DTSs and PTSs. so 
[0275] The Stream Graphics Processor 34 decodes 
the ODS to obtain uncompressed graphics, and writes 
the uncompressed graphics to the Object Buffer 35. 
[0276] The Object Buffer 35 is a buffer for storing a 
plurality of sets of uncompressed graphics (represented 35 
by the rectangles in the drawing) generated by the 
Stream Graphics Processor 34. 

[0277] The Composition Buffer36 is a memory for stor- 
ing an ICS. The Composition Buffer 36 outputs a plurality 
of sets of page information in the ICS and a plurality of "^o 
buttonjnfo structures in each set of page information, to 
the Graphics Controller 37. 

[0278] The Graphics Controller 37 refers to each 
buttonjnfo structure in page information specified by 
PSR1 1 (current page information) out of the plurality of 
sets of page information in the ICS stored in the Compo- 
sition Buffer 36, and renders graphics. In detail, the 
Graphics Controller 37 reads graphics specified by a 
start_object_id_normal field value and an end_object_ 
id_normal field value of normal_state_info of each 50 
buttonjnfo structure in the current page information from 
the Obj ect Buffer 35, and writes the read graphics to the 
Interactive Graphics Plane 15. Regarding a buttonjnfo 
structure specified by PSR1 0, the Graphics Controller 37 
reads graphics specified by a start_objectJd_selected 55 
field value and an end_objectJd_selected field value of 
selected_stateJnfo of the buttonjnfo structure from the 
Object Buffer 35, and writes the read graphics to the In- 
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teractive Graphics Plane 15. Arrows bgl, bg2, bg3, and 
bg4 in FIG. 44 represent the rendering of the graphics 
by the Graphics Controller 37. As a result of the render- 
ing, a Page including Buttons 1 -A to 1 -D is stored on the 
Interactive Graphics Plane 15 and overlaid on a moving 
picture. 

[0279] This concludes the rough description of the pro- 
cedure to be performed by the Graphics Controller 37. 
FIGS. 45 to 51 show the procedure to be performed by 
the Graphics Controller 37 in greater detail. 
[0280] FIG. 45 is a flowchart of a main routine of the 
procedure performed by the Graphics Controller 37. In 
this flowchart, while conducting step S88 (an animation 
procedure) and step S89 (an UO procedure) , judgments 
are made in steps S81 , S82, and S83 as to whether spe- 
cific events have occurred. If any of the events has oc- 
curred, corresponding steps are performed and the pro- 
cedure returns to the main routine. 
[0281] A judgment is made as to whether the current 
playback time has reached a point when the ICS be- 
comes valid (S81). If the judgment in step S81 is YES, 
PSR1 0 is set to specify first page information in the ICS 
(S84) . After this, a current page display procedure is 
carried out (S85). 

[0282] A judgment is made as to whether the current 

playback time has reached a point shown by the 
selection Jime_outjDts (S82) . If the judgment in step 

582 is YES, a button activation procedure is carried out 

(S86). 

[0283] A judgment is made as to whether the current 
playback time has reached a point shown by the 
compositionjime out_pts (S83). If the judgment in step 

583 is YES, the Interactive Graphics Plane 15 is cleared 
and PSR10 and PSR11 are changed to Invalid (S87). 
This completes the synchronization procedure using time 
stamps. In this synchronization procedure, steps S85 and 
S86 are performed by calling subroutines. A procedure 
of the subroutine of step S85 is described below, with 
reference to FIG. 46. 

[0284] FIG. 46 is a flowchart of an initial display pro- 
cedure. A display effect specified by the in_effects field 
of the current page information is executed (S91). After 
this, a current button setting procedure is performed 
(S92). The current Button is specified by PSR1 0. Accord- 
ingly, "Procedure when playback condition is changed" 
for PSR1 0 is performed to determine the current Button. 
Once the current Button has been determined as a result 
of step S92, the procedure advances to steps S93 to S98. 
[0285] Steps S93 to S98 form a loop that is performed 
for each buttonjnfo structure in the current Page (S93 
and S94). Button-info to be processed in this loop is called 
buttonjnfo (p). 

[0286] A judgment is made as to whether buttonjnfo 
(p) corresponds to the current Button (S95). If the judg- 
ment in step S95 is YES, the procedure advances to step 
S96. If the judgment in step S95 is NO, the procedure 

advances to step S97. 

[0287] In step S96, a graphics Object specified by a 
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start_object_id_selected field value of selected_state_ 
info in buttonjnfo (p) is designated as graphics Object 
(p) in the Object Buffer 35. 

[0288] In step S97, a graphics Object specified by a 

start_object_id_normal field value of normal_state_info 5 
in button_info(p) is designated as graphics Object(p) in 
the Object Buffer 35. 

[0289] Once graphics Object (p) has been designated 
as a result of step S96 or S97, graphics Object(p) is writ- 
ten onto the Interactive Graphics Plane 15 at a position io 
specified by a button_horizontal jDosition field value and 
a button_vertical_position field value inbutton_info(p) 
(S98). As a result of performing this operation for each 
buttonjnfo structure in the current Page, among a plu- 
rality of graphics Objects associated with each button ^5 
state, an initial graphics Object is rendered for each But- 
ton to the Interactive Graphics Plane 15. 
[0290] A procedure of the subroutine of step S86 is 
explained next, with reference to FIG. 47. 
[0291 ] FIG. 47 is a flowchart of a button auto-activation 20 
procedure. A judgment is made as to whether a 
default_activated_button_id_ref is 00 or FF (SI 00). If the 
default_activated_button_id_ref is GO, the procedure re- 
turns to the main routine without performing any step. If 
the default_activated_buttonJd_ref is FF, current Button 25 
\ is activated (SI 02). Following this, variable animation 
(i) corresponding to current Button i is set to 0. The pro- 
cedure then returns to the main routine (SI 03). 
[0292] If the default_activated_button_id_ref is neither 
00 nor FF, a Button specified by the default_activated_ so 
button_id_ref is set as current Button i (SI 01), and cur- 
rent Button i is activated (SI 02). Following this, animation 
(i) corresponding to current Button i is set to 0. The pro- 
cedure then returns to the main routine (SI 03) . 
[0293] As a result of the above procedure, a Button in 35 
the selected state is activated after a predetermined time 
period. This concludes the description of the flowchart of 
FIG. 47. 

[0294] The following describes a procedure of anima- 
tion display on a Page. FIG. 48 is a flowchart of the an- "^o 
imation display procedure. 

[0295] The initial display is presented by writing the 
graphics Object specified by the start_object_id_normal 
in the normal_state_info or the start_object_id_selected 
in the selected_state_info in each buttonjnfo structure, ^5 
onto the Interactive Graphics Plane 1 5. Animation means 
an operation of updating each Button image by overwrit- 
ing the Interactive Graphics plane 15 with an arbitrary 
one of a sequence of graphics Objects (qth graphics Ob- 
ject) associated with the Button, in each repetition of the 50 
main routine. That is to say, each Button is presented in 
animation by rendering a sequence of graphics Objects 
associated with the normal_stateJnfo or selected_ 
statejnfo provided within each buttonjnfo structure, 
one by one to the Interactive Graphics Plane 15. Here, 55 
variable q is used to specify an individual graphics Object 
associated with the normal_stateJnfo or selected_ 
statejnfo provided within each buttonjnfo structure. 



[0296] The animation display procedure is described 
below, by referring to FIG. 48 . For simplicity's sake, this 
flowchart is based on a premise that the repeat_ 
normaljlag and the repeat_selectedjlag in each 
buttonjnfo structure in the ICS are set to indicate that 
the continuous repetition is required. 
[0297] A judgment is made as to whether the initial 
display has been performed (S110) If the initial display 
is not yet performed, the procedure returns to the main 
routine without performing any step. If the initial display 
has been performed, the procedure advances to steps 
S1 1 1 to S123. Steps S1 1 1 to S123 form a loop in which 
steps S1 13 to SI 23 are performed for each buttonjnfo 
structure (button Jnfo(p)) of the current page information 
in the ICS (S1 11 and S1 12). 

[0298] Variable q is set to the value of animation(p) 
corresponding to buttonjnfo(p) (S1 13). As a result, var- 
iable q represents the current frame number for 
buttonjnfo (p) . 

[0299] A judgment is made as to whether buttonjnfo 
(p) corresponds to the current Button, i.e. the Button 
which is currently in the selected state (S1 14). 
[0300] If the judgment in step SI 44 is NO, a value ob- 
tained by adding variable q to the start_objectJd_normal 
of the normal_stateJnfo in buttonjnfo (p) is set as ID 
(q) (S1 15). 

[0301] If the judgment in step S1 14 is YES, the proce- 
dure advances to step S1 16. 

[0302] In step S1 1 6, a judgment is made as to whether 
the current Button is in the activated state. If the current 
button is in the activated state, a value obtained by adding 
variable q to the start_objectJd_activated of the 
actioned_stateJnfo in buttonjnfo (p) is set as ID(q) 
(S1 1 7). After this, one of button commands in buttonjnfo 
(p) is executed (S1 1 8). 

[0303] If the current Button is not in the activated state, 
a value obtained by adding variable q to the 
start_objectJd_selected of the selected_stateJnfo in 
button Jnfo(p) is set as ID(q) (S1 19). 
[0304] Once ID(q) has been determined in this way, 
graphics Object (q) identified by ID (q) is read from the 
Object Buffer 35 and written to the Interactive Graphics 
Plane 15 at a position shown by the button_horizontal_ 
position and the button_vertical_position in buttonjnfo 
(P) (S120). 

[0305] As a result, the qth graphics Object in the se- 
quence of graphics Objects representing the selected 
state (or the activated state) of the current Button or the 
normal state of any of the other Buttons in animation is 
obtained on the Interactive Graphics Plane 15. 
[0306] A judgment is made as to whether the sum of 
the start_objectJd_normal and variable q has reached 
the end_objectJd_normal in buttonjnfo(p) (SI 21 ). If the 
judgment in step 8121 is NO, variable q is incremented 
by 1 and assigned to animation(p) (S122). If the judgment 
in step SI 21 is YES, animation (p) is initialized to 0 
(SI 23). The above operation is repeated for each 
buttonjnfo structure of the current page information in 
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the ICS (S1 1 1 and S1 12) . Once the operation has been 
completed for all buttonjnfo structures, the procedure 
returns to the main routine. 

[0307] As a result of steps S1 10 to S123, each Button 
image on the Interactive Display is updated using a new 5 
graphics Object each time the main routine is performed. 
Repeating the main routine over and over again enables 
the Button images to be presented in animation. When 
presenting the Buttons in animation, the Graphics Con- 
troller 37 adjusts the duration for presenting each graph- io 
ics Object so as to maintain the animation_frame_ 
rate_code. 

[0308] A button command execution procedure is ex- 
plainedbelow, with reference to a flowchart of FIG. 49. 
One button_command is extracted from in the ^5 
buttonjnfo (SI 31). A judgment is made as to whether 
the button_command is a Page switching command 
(S132). If the button_command is not a Page switching 
command, the button_command is executed (SI 33). If 
the button_command is a Page switching command, a 20 
display effect specified by the out_effects in the current 
Page is executed (SI 34). Following this, a switching des- 
tination page number specified by an operand of the 
button_command is set as X, and a button number spec- 
ified by an operand of the button_command is set in 25 
PSR10 (SI 35) . After this, "Procedure when change is 
requested" for PSR11 is performed (S136). PSR11 spec- 
ifies the current Page. By performing "Procedure when 
change is requested" for such PSR1 1 , the current Page 
is determined. After this, "Procedure when playback con- 30 
dition is changed" is performed for PSR10. This com- 
pletes the button command execution procedure. 
[0309] This concludes the description of the button 
command execution procedure. The following describes 
an UO procedure in step S89 of the main routine, with 35 
reference to FIG. 50. 

[0310] FIG. 50 is a flowchart of the UO procedure. In 
this flowchart, steps SI 40 to SI 43 are performed to judge 
whether specific events have occurred. If any of the 
events has occurred, corresponding steps are performed 
and then the procedure returns to the main routine. A 
judgment is made as to whether the UO_mask_table in 
the current Page is set to 1 (SI 40). If the judgment in 
step S1 40 is YES, the procedure returns to the main rou- 
tine without performing any step. ^5 
[0311] A judgment is made as to whether any of the 
Move Up key, the Move Down key, the Move Left key, 
and the Move Right key has been pressed (SI 41 ). If the 
judgment in step SI 41 is YES, a current Button change 
procedure is performed (SI 47), and a judgment is made 50 
as to whether the auto_action_flag of the current Button 
is 01 (SI 48). If the judgment in step S148 is NO, the 
procedure returns to the main routine. If the judgment in 
step SI 48 is YES, the procedure advances to step SI 44. 
[0312] A judgment is made as to whether a numeric 55 
input has beenmade (SI 43) . If the numeric input has 
beenmade, a numeric input operation is performed 
(SI 46). After this, the procedure returns to the main rou- 



tine. 

[031 3] A judgment is made as to whether the Activated 
key has been pressed (SI 42). If the judgment in step 
S142 is YES, current Button i is activated (SI 44). After 
this, animation(i) is set to 0 (S145). In the procedure 
shown in FIG. 50, step SI 47 is performed by calling a 
subroutine. FIG. 51 shows a procedure of this subroutine. 
[0314] FIG. 51 is a flowchart of a current button change 
procedure. First, from the upper_button_number, the 
lower_button_number, the left_button_number, and the 
right_button_number in the neighborjnfo associated 
with the current Button, a button number that corre- 
sponds to the pressed key is specified (SI 50). 
[031 5] The current Button is set as button Y, and a new 
Button identified by the specified button number is set as 
Button X (SI 51). To set PSR10 to X, "Procedure when 
change is requested" is performed (SI 52). 
[0316] After the setting, animation (X) and animation 
(Y) are set to 0. The procedure then returns to the main 
routine (SI 53). 

[0317] This concludes the description of the proce- 
dures performed by the Interactive Graphics Decoder 1 3. 

<Specific Examples of Focus Shift> 

[0318] In the above Page switching, the author decides 
which Button in the switch destination Page is to be set 
in the selected state. This raises an issue of how to per- 
form a focus shift. A focus referred to here indicates a 
Button which is in the selected state. A focus shift is to 
dynamically or statically change the Button in the select- 
ed state in accordance with Page switching, using the 
aforementioned button command or default selected but- 
ton. 

[0319] The following describes a focus shift for aiding 
the viewing of a package medium on which a plurality of 
sets of content such as a drama series are recorded. In 
the package medium recording the drama series, content 
corresponding to each of the episodes such as the first 
to fourth episodes is contained in one disc. In this case, 
playback is generally performed in the order of episodes, 
i.e. the first episode the second episode the third 
episode the fourth episode. This being so, it is trou- 
blesome for the user to perform, on a selection menu, an 
operation of selecting the next episode each time play- 
back of one episode ends. 

[0320] FIG. 52 shows a specific example of this selec- 
tion operation. In the drawing, the selection menu has 
Buttons corresponding to the first to fourth episodes. 
When the selection of one Button is confirmed, a chapter 
menu for an episode corresponding to that Button is dis- 
played. After the display of the chapter menu, the selec- 
tion menu is displayed again. On this selection menu, 
the user needs to perform a key operation to select the 
next episode. In detail, when a chapter menu of the first 
episode is displayed (hwl ) and then the selection menu 
is displayed again (hw2), the user needs to perform a 
key operation (ksl) to select the second episode. 
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[0321] Also, when a chapter menu of the second epi- 
sode is displayed (hw3) and then the selection menu is 
displayed again (hw4), the user needs to perform a key 
operation (ks2) to select the third episode. 
[0322] A focus shift alleviates such a trouble of having 5 
to perform key operations. The following describes a pro- 
cedure of performing a focus shift. FIG. 53 shows how 
Pages 1 to shown in FIG. 52 are assigned to the selection 
menu and the chapter menus. Here, Page 1 is assigned 
to the selection menu, Page 2 is assigned to the chapter io 
menu of the first episode, Page 3 is assigned to the chap- 
ter menu of the second episode, and Page 4 is assigned 
to the chapter menu of the third episode. 
[0323] Also, Buttons 1 -A to 1 -D on Page 1 are assigned 
respectively to selection Buttons for the first to fourth ep- 15 
isodes in the selection menu, and Buttons 2-A to 2-F on 
Page 2 are assigned respectively to selection Buttons 
for chapters 1 to 5 and a return Button in the chapter 
menu of the first episode. The return Button referred to 
here is a Button for accepting a user operation of display- 20 
ing the selection menu again. 

[0324] This being the case, button commands of But- 
ton 1-A on Page 1 and button commands of Button 2-F 
on Page 2 define procedures such as those shown in 
FIG. 54. Procedures defined by the button commands of 25 
Button 1 -A are the following. When t:he selection of But- 
ton 1 -A is confirmed, (1 ) the value of PSR1 0 is saved to 
a GPR, (2) PSR1 1 is set to 2, and (3) PSR1 0 is set to 1 . 
[0325] By setting the PSRs in this way, the chapter 
menu of t:he first episode is displayed with Button 2-A 3o 
being in the selected state. 

[0326] Meanwhile, procedures defined by the button 
commands of Button 2-F are the following. When the 
selection of Button 2-F is confirmed, (1 ) PSR1 1 is set to 
1 , and (2) PSR1 0 is set to a sum of 1 and the value saved 35 
to the GPR. 

[0327] According to these procedures defined by the 
button commands of Button 1 -A on Page 1 and Button 

2-F on Page 2, when the display of the chapter menu of 
the first episode ends and the selection menu is displayed 
again, the focus is automatically shifted from the Button 
for the first episode to the Button for the second episode 
on the selection menu. By defining button commands of 
Buttons 1 -B to 1 -D on Page 1 and the Buttons of the other 
Pages in a similar way, focus shifts such as those shown ^5 
in FIG. 55 can be realized. 

[0328] With the aid of such focus shifts, the user can 
easily search the drama series made up of a number of 
sets of content, for a chapter which he or she wants to 
view. 50 
[0329] To realize the above focus sh ifts, it is necessary 
to define button commands for each individual Button. 
This being so, if there are many Pages and Buttons, a 
bug may occur. This raises the need for conducting a 
test to find bugs. 55 
[0330] Bugs likely to occur in focus shifts are as follows. 
When displaying Page 1, if the above procedures are 
performed while Button 1-D is in the selected state, a 
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button number (= 5) obtained by adding 1 to a button 
number of Button 1 -D is written to PSR1 0 upon switching 
from Page 1 , Page 2, and back to Page 1 . Since Page 1 
does not have a fifth Button, the focus will end up being 
shifted to a nonexistent Button on Page 1. Also, there 
may be a case where after the sixth Button (Button 1 -F) 
on Page 2 is set in the selected state. Page 1 is displayed 
again without updating PSR10, as shown in FIG. 56. In 
this case too, the focus will end up being shifted to a 
nonexistent Button on Page 1. Thus, when the number 
of Buttons on each Page is different, a bug of putting a 
nonexistent Button on a switch destination Page into the 
selected state can occur frequently. Such defects need 
be corrected upon shipment of content. Accordingly, the 
author must perform a debug test to ensure normal op- 
erations, as in the case of shipment of programs. How- 
ever, the imperative for the author to perform such a de- 
bug test as being conducted by a software house may 
adversely affect the content production that is the core 
business of the author. 

[0331] In view of this, the third embodiment of the 
present invention applies status transitions through "Pro- 
cedure when playback condition is changed" and "Pro- 
cedure when change is requested", to PSR10 and 
PSR1 1 in the same way as PSR1 , PSR2, and PSR3. 

<Status transitions of PSR1 1 > 

[0332] PSR1 1 specifies a Page which is currently dis- 
played among a plurality of Pages included in the IG 
stream (current Page) . PSR1 1 takes one of the values 
00 to FF, and the playback apparatus displays the Page 
specified by PSR1 1. FIG. 57A shows status transitions 
that can be made by PSR1 1 . When comparing this draw- 
ing with FIG. 15A, it can be seen that there is no status 
transition triggered by the "Cross a Playltem boundary" 
event. Also, an event that triggers a status transition from 
Invalid to Valid has been changed from "Start PlayList 
playback" to "Interactive Composition Segmentbecomes 
Valid", and an event that triggers a status transition from 
Valid to Invalid has been changed from "Terminate Play- 
List playback" to "Interactive Composition Segment be- 
comes Invalid". Also, "Procedure when change is re- 
quested" has been changed from "stream change is re- 
quested" to "page change is requested. Apart from these 
differences, FIG. 57A is same as FIG. 15A. 
[0333] "Interactive Composition Segment becomes 
Invalid" includes an event that the current playback time 
has reached a point specified by the composition_ 

time ^out_pts in an ICS, an event that an ICS has 

changed, and an event that PlayList playback ends. The 
number of audio streams differs for each Playltem. Ac- 
cordingly, when PlayList playback starts and each time 
a Playltem boundary is crossed, "Procedure when play- 
back condition is changed" needs to be performed to set 
PSR1 . However, PSR1 1 is used only in a playback sec- 
tion where an ICS is multiplexed, and so there is no need 
to perform "Procedure when playback condition is 
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changed" each time a Playltem boundary is crossed. 
Therefore, a status transition from Invalid to Valid of 
PSR1 1 is triggered by an event that an ICS becomes 
Valid. 

[0334] "Procedure when playback condition is 5 
changed" for PSR1 1 is explained below. FIG. 57B is a 
flowchart of "Procedure when playback condition is 
changed" for PSR11. In "Procedure when playback con- 
dition is changed", first page information in the ICS is set 
in PSR11 (S154). 10 
[0335] FIG. 57C is a flowchart of "Procedure when 
change is requested" for PSR11 . A judgment is made as 
to whether X is Valid (S155). If X is Valid, X is assigned 
to PSR1 1 (S156). If X is Invalid, the value of PSR1 1 is 
maintained (S157). This concludes the description of 15 
PSR11. 

<Status Transitions of PSR10> 

[0336] The following describes status transitions of 20 
PSR10. FIG. 58A shows status transitions that can be 
made by PSR1 0. This drawing is same as FIG. 57A, ex- 
cept that a status transition triggered by an event 
"Change Page" or "Button Disabled" has been added. 
Also, "Procedure when change is requested" has been 25 
changed from "page change is requested" to "button 
change is requested". 

[0337] "Change Page" is an event that Page switching 
is requested. "Button Disabled" is an event that a Button 
displayed on a Page is disabled. Upon the occurrence 30 
of such an event, "Procedure when playback condition 
is changed" is performed to set PSR1 0, and then PSR1 0 
returns to Valid. 

[0338] "Procedure when playback condition is 
changed" and "Procedure when change is requested" for 35 
PSR10 are described below. 

[0339] FIG. 58B is a flowchart of "Procedure when 
playback condition is changed" for PSR10. 
[0340] A judgment is made as to whether the 
default_selected_button_id_ref in the current Page is 
Valid(S161). lfthejudgmentinstepS161 is YES, PSR10 
is set to the default_selected_button_id_ref (S162). 
[0341 ] If the judgment in step S1 61 is NO, a judgment 
is made as to whether PSR1 0 is Valid (SI 63) . If PSR1 0 
is Valid, the value of PSR10 is maintained (S164). If 45 
PSR10 is Invalid, PSR10 issettoabutton number of the 
first button_info structure in the current Page (SI 65). 
[0342] FIG. 59 is a flowchart of "Procedure when 
change is requested" for PSR10. First, a judgment is 
made as to whether X is Valid (SI 66). If X is Valid, PSR10 so 
is set to X (SI 68). If X is Invalid, the value of PSR10 is 
maintained (SI 67). 

[0343] According to the above procedures, when 
PSR1 0 is Invalid, PSR1 0 is set so that the Button spec- 
ified by the first buttonjnfo structure of the current Page 55 
is set in the selected state. Accordingly, even if the author 
designates a button number of a Button which does not 
exist in a switch destination Page, a process of changing 
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the wrong button number to a correct button number is 
automatically performed. Thus, even if a button com- 
mand for realizing a focus shift has a defect, such a defect 
can be automatically corrected. This reduces the burden 
on the author. 

Modifications 

[0344] Though the present invention has been de- 
scribed by way of the above embodiments, the present 
invention is not limited to such. The present invention 
can be realized with any of modifications (A) to (M) given 
below. The invention of each of the claims of this appli- 
cation includes extension and generalization of the above 
embodiments and their modifications below. The degree 
of extension and generalization depends upon the state 
of the art in the technical field of the present invention at 
the time of filing of this application. 

(A) The above embodiments describe the case 
where the BD-ROM is used as the recording medium 
according to the present invention. Main features of 
the present invention, however, lie in a graphics 
stream recorded on the recording medium, which 
does not rely on physical characteristics of 
BD-ROMs. Therefore, the present invention is appli- 
cable to any recordingmediumthat is capable of re- 
cording a graphics stream. Examples of such a re- 
cording medium include: an optical disc such as a 
DVD-ROM, a DVD-RAM, a DVD-RW, a DVD-R, a 
DVD+RW, a DVD+R, a CD-R, or a CD-RW; a mag- 
neto-optical disk such as a PD or an MO; a semicon- 
ductor memory card such as a CompactFlash card, 
a SmartMedia card, a Memory Stick card, a Multi- 
MediaCard, or a PCMCIAcard; a magneticdisksuch 
as a flexible disk, SuperDisk, Zip, or ClikI; a remov- 
able hard disk drive such as ORB, Jaz, SparQ, SyJet, 
EZFley, or Microdrive, and a nonremovable hard disk 
drive. 

(B) The above embodiments describe the case 
where the playback apparatus decodes an AV Clip 
on the BD-ROM and outputs the decoded AV Clip 
to the television. As an alternative, the playback ap- 
paratus may be equipped with only a BD-ROM drive, 
with the remaining construction elements being pro- 
vided in the television. In this case, the playback ap- 
paratus and the television can be incorporated in a 
home network connected with an IEEE 1394 con- 
nector. The above embodiments describe the case 
where the playback apparatus is connected to the 
television, but the playback apparatus may instead 
be integrated with a display device. Also, the play- 
back apparatus may include only the systemLSI (in- 
tegrated circuit) which constitutes an essential part 
of processing. The playback apparatus and the in- 
tegrated circuit are both an invention described in 
this specification. Accordingly, regardless of whether 
the playback apparatus or the integrated circuit is 
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concerned, an act of manufacturing a playback ap- 
paratus based on the internal construction of the 
playback apparatus described in the first embodi- 
ment is an act of working of the present invention. 
Also, any act of assigning with charge (i.e. for sale) 5 
or without charge (i.e. as a gift), leasing, and import- 
ing the playback apparatus is an act of workin- 
gofthepresentinvention. Likewise, an act of offering 
for assignment or lease of the playback apparatus 
using storefront displays, catalogs, or brochures is 
an act of working of the present invention. 

(C) Information processing using the programs 
shown in the flowcharts is actually realized using 
hardware resources. Accordingly, the programs 
which describe the operational procedures shown in ^5 
the flowcharts are themselves an invention. The 
above embodiments describe the case where the 
programs are incorporated in the playback appara- 
tus, but the programs can be used independently of 

the playback apparatus. Acts of working of the pro- 20 
grams include (1) an act of manufacturing, (2) an act 
of assigning with or without charge, (3) an act of leas- 
ing, (4) an act of importing, (5) an act of providing to 
the public via a bi-directional electronic communica- 
tions network, and (6) an act of offering for assign- 25 
ment or lease using storefront displays, catalogs, or 
brochures. 

(D) The time elements of the steps which are exe- 
cuted in a time series in each of the flowcharts can 

be regarded as the necessary elements of the so 
present invention. This being so, a playbackmethod 
shown by these flowcharts is an invention. If the 
processing shown in each flowchart is carried out by 
performing the steps in a time series so as to achieve 
the intended aim and the intended effect, this is an 35 
act of working of the recording method of the present 
invention. 

(E) When recording an AV Clip on the BD-ROM, an 
extension header may be added to each TS packet 
in the AV Clip. The extension header is called a 
TP_extra_header, includes an arrival_time_stamp 
and a copy_permission_indicator, and has a data 
length of 4 bytes. TS packets with TP_extra_headers 
(hereafter "EX TS packets") are grouped in units of 

32 packets, and each group is written to three sec- ^5 
tors. One group made up of 32 EX TS packets has 
6, 1 44 bytes (= 32x1 92), which is equivalent to a size 
of three sectors that is 6144 bytes (= 2048x3). The 
32 EX TS packets contained in the three sectors are 
called an Aligned Unit. 50 
In a home network connected with an IEEE 1394 
connector, the playback apparatus transmits an 
Aligned Unit in the following manner. The playback 
apparatus removes a TP_extra_header from each 
of the 32 EXTS packets in the Aligned Unit, encrypts 55 
the body of each TS packet according to the DTCP 
Specification, and outputs the encrypted TS packets. 
When outputting the TS packets, the playback ap- 



paratus inserts an isochronous packet between ad- 
jacent TS packets. A position where the isochronous 
packet is inserted is based on a time shown by an 
arrival_time_stamp of the TP_extra_header. The 
playback apparatus outputs a DTCP_descriptor, as 
well as the TS packets. The DTCP_descriptor cor- 
responds to a copy_permission_indicator in the 
TP_extra_header. With the provision of the 
DTCP_descriptor indicating "copy prohibited", it is 
possible to prevent, when using the TS packets in 
the home network connected with the IEEE 1394 
connector, the TS packets from being recorded to 
other devices. 

(F) The above embodiments describe the case 
where an AV Clip of the Blu-ray Disc Read-Only For- 
mat is used as a digital stream, but the present in- 
vention can also be realized with a VOB (Video Ob- 
ject) of the DVD-Video Format or the DVD-Video Re- 
cording Format. The VOB is a program stream that 
complies with the ISO/IEC 1 381 8-1 Standard and is 
obtained by multiplexing a video stream and an audio 
stream. Also, the video stream in the AV Clip may 
be an MPEG4 video stream or a WMV video stream. 
Further, the audio stream in the AV Clip may be a 
Linear PCM audio stream, an MP3 audio stream, or 
an MPEG-AAC audio stream. 

(G) The movie content described in the above em- 
bodiments may be obtained by encoding an analog 
image signal broadcast by analog broadcasting. Al- 
so, the movie content may be stream data made up 
of a transport stream broadcast by digital broadcast- 
ing. 

Alternatively, an analog/digital image signal record- 
ed on a videotape may be encoded to obtain content. 
Also, an analog/digital image signal directly captured 
by a video camera may be encoded to obtain content. 
A digital work distributed by a distribution server is 
applicable too. 

(H) Graphics Objects described in the above embod- 
iments is run-length encoded rasterdata. Run-length 
encoding is used for compression/encoding of 
graphics Objects, because the run-length encoding 
is most suitable for compression and decompression 
of subtitles. Subtitles have a property in that a con- 
tinuous length of the same pixel value in a horizontal 
direction is relatively long. Therefore, by performing 
compression using run-length encoding, a high com- 
pression rate can be attained. In addition, run-length 
encoding reduces a load for decompression, and is 
therefore suitable for realizing decoding by software. 
For the purpose of providing a decoding construction 
common to subtitles and Buttons, the compression 
and decompression method used for subtitles is also 
employed for Buttons. Nevertheless, the use of 
run-length encoding for graphics Objects is not a lim- 
itation of the present invention. For example, graph- 
ics Objects may be PNG data. Also, graphics Objects 
may be vector data instead of raster data. Further, 
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Claims 

1. A playback apparatus for playing back a digital 
stream generated by multiplexing a plurality of ele- 
mentary streams, comprising: 



Industrial Applicability 

[0345] The above embodiments disclose the internal 
construction of the playback apparatus to which the 
present invention relates, and the playback apparatus 
can be manufactured in volume based on the disclosed 
internal construction. In other words, the playback appa- 
ratus are capable of being industrially used. Hence the 
playback apparatus has industrial applicability. 



, for each el- 
lity of prede- 
/ stream sat- 
isfies; and 

a playback unit operable to assign a priority to 
each elementary stream according to a pattern 
of conditions the elementary stream satisfies, 
and select and play back a highest-priority ele- 
mentary stream. 

2. The playback apparatus of Claim 1 , wherein 

the playback unit assigns a higher priority to the el- 
ementary stream if the elementary stream satisfies 
more conditions. 



graphics Objects may be transparent patterns. 
(I) Subtitle graphics selected according to a display 
setting of the playback apparatus may be subjected 
to display effects of PCSs. For example, graphics of 
various display modes such as wide screen, pan and 5 
scan, and letterbox are recorded on the BD-ROM, 
and the playback apparatus selects one of these dis- 
play modes according to a display setting of the tel- 
evision connected with the playback apparatus and 
displays corresponding graphics. Since the display 
effects of PCSs are applied to such subtitle graphics, 
viewability increases. As a result, display effects 
achieved by using characters which are contained 
within the body of video can be realized with subtitle 
graphics displayed according to the display setting. ^5 
This contributes to high practicality. 
(J) The above embodiments describe the case 
where the playback apparatus includes a Graphics 
Plane. Alternatively, the playback apparatus may in- 
clude a line buffer for storing uncompressed pixels 20 
of one line. Since conversion to an image signal is 
performed for each horizontal row (line), conversion 
to an image signal can equally be performed with 
the line buffer. 

(K) The third embodiment describes the case where 25 
button commands for setting PSR1 0 and PSR1 1 are 
written in an ICS, but button commands for setting 
PSR1, PSR2, and PSR3 may be written in the ICS 
too. For example, if PSR2 specifies English subtitles, 
button commands for selecting Japanese subtitles so 
may be provided. 

(L) A default Button may be provided on each of an 
audio selectionmenu and a subtitle selectionmenu 
used for receiving an audio stream selection and a 
subtitle stream selection. Button information corre- 35 
spending to such a default Button has button com- 
mands for setting PSR1 or PSR2 to an undefined 
value. If the default Button is activated and these 
button commands are executed, PSR1 or PSR2 is 
set to the undefined value, and "Procedure when 
playback condition is changed" is performed to se- 
lect an optimal audio stream or PG_textST_stream. 
(M) The first embodiment describes the case where 
the three conditions (a) to (c) are used, but the 
number of conditions may be four or more. 
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a judgment unit operable to judge 
ementary stream, which of a plura 
termined conditions the elementar 
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3. The playback apparatus of Claim 1 , wherein: 
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the plurality of predetermined conditions include 
a first condition, a second condition, and a tliird 
condition; 

tine first condition is that the playback apparatus 
has a capability of playing back the elementary 5 
stream; 

the second condition is that a language attribute 
of the elementary stream matches a language 
setting of the playback apparatus; 
the third condition is that a channel attribute of io 
the elementary stream is surround sound and 
the playback apparatus has a surround output 
capability; and 

the playback unit assigns a higher priority to the 
elementary stream if the elementary stream sat- ^5 
isfies the first condition and the second condi- 
tion, than if the elementary stream satisfies the 
first condition and the third condition. 

4. The playback apparatus of Claim 1 , further compris- 20 
ing 

a status register, wherein 

the playback unit performs the selection by setting 
a stream number of the highest-priority elementary 
stream in the status register. 25 

5. The playback apparatus of Claim 4, wherein: 

a plurality of sets of playback section information 
are recorded on a recording medium; so 
the judgment by the judgment unit and the se- 
lection by the playback unit are performed when 
playback according to one of the plurality of sets 
of playback section information begins; and 
the status register is set tobe invalid when the 35 
playback according to the set of playback sec- 
tion information ends. 



7. The playback apparatus of Claim 6, further compris- 
ing 

a reception unit operable to receive a user operation, 
wherein 

the acquisition unit acquires the switching destina- 
tion stream number based on the user operation re- 
ceived by the reception unit. 

8. The playback apparatus of Claim 6, further compris- 
ing 

an execution unit operable to execute a command 
recorded on a recording medium, wherein 
the acquisition unit acquires the switching destina- 
tion stream number based on the command execut- 
ed by the execution unit. 

9. The playback apparatus of Claim 6, wherein 

the switching destination stream number is invalid if 
the switching destination stream number exceeds a 
number of entries in a predetermined table. 

10. The playback apparatus of Claim 4, further compris- 
ing 

a setting unit operable to set a predetermined unde- 
fined value in the status register when a recording 
medium is loaded to the playback apparatus, where- 
in 

the judgment by the judgment unit and the selection 
by the playback unit are performed if a set value of 
the status register is the predetermined undefined 
value. 

11. A computer-readable program used for enabling a 
computer to play back a digital stream generated by 
multiplexing a plurality of elementary streams, the 
program enabling the computer to perform the steps 
of: 



6. The playback apparatus of Claim 4, further compris- 
ing: 40 

an acquisition unit operable to acquire, when a 
stream switching request is made, a switching 
destination stream number; and 
a setting unit operable to set, if the switching ^5 
destination stream number is valid, the switch- 
ing destination stream number in the status reg- 
ister, wherein: 

if the switching destination stream number 50 
is invalid, a set value of the status register 

is maintained; and 

the judgment by the judgment unit and the 
selection by the playback unit are per- 
formed if the switching destination stream 55 
number is a predetermined undefined val- 
ue. 



judging, for each elementary stream, which of a 
plurality of predetermined conditions the ele- 
mentary stream satisfies; and 
assigning a priorityto each elementary stream 
according to a pattern of conditions the elemen- 
tary stream satisfies, and selecting and playing 
back a highest-priority elementary stream. 

12. A playback method of playing back a digital stream- 
generated by multiplexing a plurality of elementary 
streams, comprising the steps of: 

judging, for each elementary stream, which of a 
plurality of predetermined conditions the ele- 
mentary stream satisfies; and 
as signing a priority to each elementary stream 
according to a pattern of conditions the elemen- 
tary stream satisfies, and selecting and playing 
back a highest-priority elementary stream. 
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